Nov 28 06:34:03 user nova-compute[74870]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74870) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 06:34:03 user nova-compute[74870]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74870) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 06:34:03 user nova-compute[74870]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74870) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 06:34:03 user nova-compute[74870]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:34:04 user nova-compute[74870]: INFO nova.virt.driver [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 06:34:04 user nova-compute[74870]: INFO nova.compute.provider_config [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Acquiring lock "singleton_lock" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Acquired lock "singleton_lock" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Releasing lock "singleton_lock" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Full set of CONF: {{(pid=74870) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ******************************************************************************** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Configuration options gathered from: {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ================================================================================ {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] allow_resize_to_same_host      = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] arq_binding_timeout            = 300 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] backdoor_port                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] backdoor_socket                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] block_device_allocate_retries  = 300 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] block_device_allocate_retries_interval = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cert                           = self.pem {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute_monitors               = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] config_dir                     = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] config_drive_format            = iso9660 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] config_source                  = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] console_host                   = user {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] control_exchange               = nova {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cpu_allocation_ratio           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] daemon                         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] debug                          = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] default_access_ip_network_name = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] default_availability_zone      = nova {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] default_ephemeral_format       = ext4 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] default_green_pool_size        = 1000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] default_schedule_zone          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] disk_allocation_ratio          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] enable_new_services            = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] enabled_apis                   = ['osapi_compute'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] enabled_ssl_apis               = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] flat_injected                  = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] force_config_drive             = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] force_raw_images               = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] graceful_shutdown_timeout      = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] heal_instance_info_cache_interval = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] host                           = user {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_build_timeout         = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_delete_interval       = 300 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_format                = [instance: %(uuid)s]  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_name_template         = instance-%08x {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_usage_audit           = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_usage_audit_period    = month {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] internal_service_availability_zone = internal {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] key                            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] live_migration_retry_count     = 30 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_config_append              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_dir                        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_file                       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_options                    = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_rotate_interval            = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_rotate_interval_type       = days {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] log_rotation_type              = none {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] long_rpc_timeout               = 1800 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] max_concurrent_builds          = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] max_concurrent_live_migrations = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] max_concurrent_snapshots       = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] max_local_block_devices        = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] max_logfile_count              = 30 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] max_logfile_size_mb            = 200 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] maximum_instance_delete_attempts = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metadata_listen                = 0.0.0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metadata_listen_port           = 8775 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metadata_workers               = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] migrate_max_retries            = -1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] mkisofs_cmd                    = genisoimage {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] my_ip                          = 10.0.0.210 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] network_allocate_retries       = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] osapi_compute_listen_port      = 8774 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] osapi_compute_unique_server_name_scope =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] osapi_compute_workers          = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] password_length                = 12 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] periodic_enable                = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] periodic_fuzzy_delay           = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] pointer_model                  = ps2mouse {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] preallocate_images             = none {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] publish_errors                 = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] pybasedir                      = /opt/stack/nova {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ram_allocation_ratio           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rate_limit_burst               = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rate_limit_except_level        = CRITICAL {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rate_limit_interval            = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reboot_timeout                 = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reclaim_instance_interval      = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] record                         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reimage_timeout_per_gb         = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] report_interval                = 120 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rescue_timeout                 = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reserved_host_cpus             = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reserved_host_disk_mb          = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reserved_host_memory_mb        = 512 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] reserved_huge_pages            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] resize_confirm_window          = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] resize_fs_using_block_device   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] resume_guests_state_on_host_boot = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rpc_response_timeout           = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] run_external_periodic_tasks    = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] running_deleted_instance_action = reap {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] running_deleted_instance_poll_interval = 1800 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] running_deleted_instance_timeout = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler_instance_sync_interval = 120 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_down_time              = 720 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] servicegroup_driver            = db {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] shelved_offload_time           = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] shelved_poll_interval          = 3600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] shutdown_timeout               = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] source_is_ipv6                 = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ssl_only                       = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] state_path                     = /opt/stack/data/nova {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] sync_power_state_interval      = 600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] sync_power_state_pool_size     = 1000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] syslog_log_facility            = LOG_USER {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] tempdir                        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] timeout_nbd                    = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] transport_url                  = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] update_resources_interval      = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_cow_images                 = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_eventlog                   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_journal                    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_json                       = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_rootwrap_daemon            = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_stderr                     = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] use_syslog                     = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vcpu_pin_set                   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plugging_is_fatal          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plugging_timeout           = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] virt_mkfs                      = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] volume_usage_poll_interval     = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] watch_log_file                 = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] web                            = /usr/share/spice-html5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_concurrency.disable_process_locking = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.auth_strategy              = keystone {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.compute_link_prefix        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.dhcp_domain                = novalocal {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.enable_instance_password   = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.glance_link_prefix         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.instance_list_per_project_cells = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.list_records_by_skipping_down_cells = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.local_metadata_per_cell    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.max_limit                  = 1000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.metadata_cache_expiration  = 15 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.neutron_default_tenant_id  = default {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.use_forwarded_for          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.use_neutron_default_nets   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_dynamic_targets = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_jsonfile_path   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.backend                  = dogpile.cache.memcached {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.backend_argument         = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.config_prefix            = cache.oslo {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.dead_timeout             = 60.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.debug_cache_backend      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.enable_retry_client      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.enable_socket_keepalive  = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.enabled                  = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.expiration_time          = 600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.hashclient_retry_attempts = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_dead_retry      = 300 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_password        =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_pool_maxsize    = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_sasl_enabled    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.memcache_username        =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.proxies                  = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.retry_attempts           = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.retry_delay              = 0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.socket_keepalive_count   = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.socket_keepalive_idle    = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.socket_keepalive_interval = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.tls_allowed_ciphers      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.tls_cafile               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.tls_certfile             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.tls_enabled              = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cache.tls_keyfile              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.auth_section            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.auth_type               = password {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.cafile                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.certfile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.collect_timing          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.cross_az_attach         = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.debug                   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.endpoint_template       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.http_retries            = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.insecure                = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.keyfile                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.os_region_name          = RegionOne {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.split_loggers           = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cinder.timeout                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.cpu_dedicated_set      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.cpu_shared_set         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.image_type_exclude_list = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.max_concurrent_disk_ops = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.max_disk_devices_to_attach = -1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.resource_provider_association_refresh = 300 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.shutdown_retry_interval = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] conductor.workers              = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] console.allowed_origins        = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] console.ssl_ciphers            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] console.ssl_minimum_version    = default {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] consoleauth.token_ttl          = 600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.cafile                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.certfile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.collect_timing          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.connect_retries         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.connect_retry_delay     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.endpoint_override       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.insecure                = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.keyfile                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.max_version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.min_version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.region_name             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.service_name            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.service_type            = accelerator {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.split_loggers           = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.status_code_retries     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.timeout                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] cyborg.version                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.backend               = sqlalchemy {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.connection            = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.connection_debug      = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.connection_parameters =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.connection_recycle_time = 3600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.connection_trace      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.db_inc_retry_interval = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.db_max_retries        = 20 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.db_max_retry_interval = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.db_retry_interval     = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.max_overflow          = 50 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.max_pool_size         = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.max_retries           = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.mysql_wsrep_sync_wait = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.pool_timeout          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.retry_interval        = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.slave_connection      = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] database.sqlite_synchronous    = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.backend           = sqlalchemy {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.connection        = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.connection_debug  = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.connection_parameters =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.connection_recycle_time = 3600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.connection_trace  = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.db_inc_retry_interval = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.db_max_retries    = 20 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.db_max_retry_interval = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.db_retry_interval = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.max_overflow      = 50 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.max_pool_size     = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.max_retries       = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.pool_timeout      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.retry_interval    = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.slave_connection  = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] api_database.sqlite_synchronous = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] devices.enabled_mdev_types     = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ephemeral_storage_encryption.enabled = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.api_servers             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.cafile                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.certfile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.collect_timing          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.connect_retries         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.connect_retry_delay     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.debug                   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.default_trusted_certificate_ids = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.enable_certificate_validation = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.enable_rbd_download     = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.endpoint_override       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.insecure                = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.keyfile                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.max_version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.min_version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.num_retries             = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.rbd_ceph_conf           =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.rbd_connect_timeout     = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.rbd_pool                =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.rbd_user                =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.region_name             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.service_name            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.service_type            = image {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.split_loggers           = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.status_code_retries     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.timeout                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.verify_glance_signatures = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] glance.version                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] guestfs.debug                  = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.config_drive_cdrom      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.config_drive_inject_password = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.enable_instance_metrics_collection = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.enable_remotefx         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.instances_path_share    =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.iscsi_initiator_list    = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.limit_cpu_features      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.power_state_check_timeframe = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.use_multipath_io        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.volume_attach_retry_count = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.vswitch_name            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] mks.enabled                    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] image_cache.manager_interval   = 2400 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] image_cache.precache_concurrency = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] image_cache.remove_unused_base_images = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] image_cache.subdirectory_name  = _base {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.api_max_retries         = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.api_retry_interval      = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.auth_section            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.auth_type               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.cafile                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.certfile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.collect_timing          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.conductor_group         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.connect_retries         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.connect_retry_delay     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.endpoint_override       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.insecure                = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.keyfile                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.max_version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.min_version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.peer_list               = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.region_name             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.serial_console_state_timeout = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.service_name            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.service_type            = baremetal {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.split_loggers           = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.status_code_retries     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.timeout                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ironic.version                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] key_manager.fixed_key          = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.barbican_api_version  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.barbican_endpoint     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.barbican_endpoint_type = public {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.barbican_region_name  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.cafile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.certfile              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.collect_timing        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.insecure              = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.keyfile               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.number_of_retries     = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.retry_delay           = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.send_service_user_token = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.split_loggers         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.timeout               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.verify_ssl            = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican.verify_ssl_path       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.auth_section = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.auth_type = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.cafile   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.certfile = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.collect_timing = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.insecure = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.keyfile  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.split_loggers = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] barbican_service_user.timeout  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.approle_role_id          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.approle_secret_id        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.cafile                   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.certfile                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.collect_timing           = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.insecure                 = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.keyfile                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.kv_mountpoint            = secret {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.kv_path                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.kv_version               = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.namespace                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.root_token_id            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.split_loggers            = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.ssl_ca_crt_file          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.timeout                  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.use_ssl                  = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.auth_section          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.auth_type             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.cafile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.certfile              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.collect_timing        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.connect_retries       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.connect_retry_delay   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.endpoint_override     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.insecure              = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.keyfile               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.max_version           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.min_version           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.region_name           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.service_name          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.service_type          = identity {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.split_loggers         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.status_code_retries   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.timeout               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] keystone.version               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.connection_uri         =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_mode               = custom {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: WARNING oslo_config.cfg [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_power_governor_high = performance {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_power_governor_low = powersave {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_power_management   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.device_detach_attempts = 8 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.device_detach_timeout  = 20 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.disk_cachemodes        = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.disk_prefix            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.enabled_perf_events    = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.file_backed_memory     = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.gid_maps               = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.hw_disk_discard        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.hw_machine_type        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_rbd_glance_store_name =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_rbd_pool        = rbd {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_type            = default {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.images_volume_group    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.inject_key             = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.inject_partition       = -2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.inject_password        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.iscsi_iface            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.iser_use_multipath     = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_bandwidth = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_downtime = 500 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_inbound_addr = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_permit_post_copy = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_scheme  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_timeout_action = abort {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_tunnelled = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: WARNING oslo_config.cfg [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 06:34:04 user nova-compute[74870]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 06:34:04 user nova-compute[74870]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 06:34:04 user nova-compute[74870]: and ``live_migration_inbound_addr`` respectively.
Nov 28 06:34:04 user nova-compute[74870]: ).  Its value may be silently ignored in the future.
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.live_migration_with_native_tls = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.max_queues             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.nfs_mount_options      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.num_memory_encrypted_guests = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.num_pcie_ports         = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.pmem_namespaces        = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.quobyte_client_cfg     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rbd_secret_uuid        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rbd_user               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.remote_filesystem_transport = ssh {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rescue_image_id        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rescue_kernel_id       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rescue_ramdisk_id      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.rx_queue_size          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.smbfs_mount_options    =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.snapshot_compression   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.snapshot_image_format  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.sparse_logical_volumes = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.swtpm_enabled          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.swtpm_group            = tss {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.swtpm_user             = tss {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.sysinfo_serial         = unique {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.tb_cache_size          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.tx_queue_size          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.uid_maps               = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.use_virtio_for_bridges = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.virt_type              = kvm {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.volume_clear           = zero {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.volume_clear_size      = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.volume_use_multipath   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_cache_path   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.vzstorage_mount_user   = stack {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.auth_section           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.auth_type              = password {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.cafile                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.certfile               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.collect_timing         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.connect_retries        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.connect_retry_delay    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.default_floating_pool  = public {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.endpoint_override      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.extension_sync_interval = 600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.http_retries           = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.insecure               = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.keyfile                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.max_version            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.min_version            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.ovs_bridge             = br-int {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.physnets               = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.region_name            = RegionOne {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.service_metadata_proxy = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.service_name           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.service_type           = network {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.split_loggers          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.status_code_retries    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.timeout                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] neutron.version                = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] notifications.bdms_in_notifications = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] notifications.default_level    = INFO {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] notifications.notification_format = unversioned {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] notifications.notify_on_state_change = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] pci.alias                      = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] pci.device_spec                = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] pci.report_in_placement        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.auth_section         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.auth_type            = password {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.cafile               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.certfile             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.collect_timing       = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.connect_retries      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.connect_retry_delay  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.default_domain_id    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.default_domain_name  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.domain_id            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.domain_name          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.endpoint_override    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.insecure             = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.keyfile              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.max_version          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.min_version          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.password             = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.project_domain_id    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.project_domain_name  = Default {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.project_id           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.project_name         = service {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.region_name          = RegionOne {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.service_name         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.service_type         = placement {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.split_loggers        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.status_code_retries  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.system_scope         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.timeout              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.trust_id             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.user_domain_id       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.user_domain_name     = Default {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.user_id              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.username             = placement {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] placement.version              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.cores                    = 20 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.count_usage_from_placement = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.injected_file_content_bytes = 10240 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.injected_file_path_length = 255 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.injected_files           = 5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.instances                = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.key_pairs                = 100 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.metadata_items           = 128 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.ram                      = 51200 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.recheck_quota            = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.server_group_members     = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] quota.server_groups            = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rdp.enabled                    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.image_metadata_prefilter = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.max_attempts         = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.max_placement_results = 1000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.query_placement_for_image_type_support = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] scheduler.workers              = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.host_subset_size = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.isolated_hosts = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.isolated_images = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.pci_in_placement = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.track_instance_changes = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metrics.required               = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metrics.weight_multiplier      = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] metrics.weight_setting         = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] serial_console.enabled         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] serial_console.port_range      = 10000:20000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] serial_console.serialproxy_port = 6083 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.auth_section      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.auth_type         = password {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.cafile            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.certfile          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.collect_timing    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.insecure          = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.keyfile           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.send_service_user_token = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.split_loggers     = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] service_user.timeout           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.agent_enabled            = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.enabled                  = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.html5proxy_port          = 6082 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.image_compression        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.jpeg_compression         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.playback_compression     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.server_listen            = 127.0.0.1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.streaming_mode           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] spice.zlib_compression         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] upgrade_levels.baseapi         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] upgrade_levels.compute         = auto {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] upgrade_levels.conductor       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] upgrade_levels.scheduler       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.auth_section = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.auth_type = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.cafile = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.certfile = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.insecure = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.keyfile = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vendordata_dynamic_auth.timeout = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.api_retry_count         = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.ca_file                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.cache_prefix            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.cluster_name            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.connection_pool_size    = 10 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.console_delay_seconds   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.datastore_regex         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.host_ip                 = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.host_password           = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.host_port               = 443 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.host_username           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.insecure                = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.integration_bridge      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.maximum_objects         = 100 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.pbm_default_policy      = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.pbm_enabled             = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.pbm_wsdl_location       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.serial_port_proxy_uri   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.serial_port_service_uri = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.task_poll_interval      = 0.5 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.use_linked_clone        = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.vnc_keymap              = en-us {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.vnc_port                = 5900 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vmware.vnc_port_total          = 10000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.auth_schemes               = ['none'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.enabled                    = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.novncproxy_port            = 6080 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.server_listen              = 0.0.0.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.vencrypt_ca_certs          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.vencrypt_client_cert       = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vnc.vencrypt_client_key        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.disable_rootwrap   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.enable_numa_live_migration = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.libvirt_disable_apic = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.client_socket_timeout     = 900 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.default_pool_size         = 1000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.keep_alive                = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.max_header_line           = 16384 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.ssl_ca_file               = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.ssl_cert_file             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.ssl_key_file              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.tcp_keepidle              = 600 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] zvm.ca_file                    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] zvm.cloud_connector_url        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] zvm.reachable_timeout          = 300 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.enforce_new_defaults = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.enforce_scope      = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.policy_default_rule = default {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.policy_file        = policy.yaml {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.connection_string     = messaging:// {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.enabled               = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.es_doc_type           = notification {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.es_scroll_size        = 10000 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.es_scroll_time        = 2m {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.filter_error_trace    = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.hmac_keys             = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.sentinel_service_name = mymaster {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.socket_timeout        = 0.1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.trace_requests        = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler.trace_sqlalchemy      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler_jaeger.process_tags   = {} {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler_jaeger.service_name_prefix = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] profiler_otlp.service_name_prefix = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] remote_debug.host              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] remote_debug.port              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.ssl      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_notifications.retry = -1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_messaging_notifications.transport_url = **** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.auth_section        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.auth_type           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.cafile              = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.certfile            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.collect_timing      = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.connect_retries     = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.connect_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.endpoint_id         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.endpoint_override   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.insecure            = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.keyfile             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.max_version         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.min_version         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.region_name         = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.service_name        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.service_type        = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.split_loggers       = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.status_code_retries = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.status_code_retry_delay = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.timeout             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.valid_interfaces    = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_limit.version             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_reports.file_event_handler = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] oslo_reports.log_dir           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_ovs_privileged.group  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] vif_plug_ovs_privileged.user   = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.flat_interface = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.isolate_vif         = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_vif_ovs.per_port_bridge     = False {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] os_brick.lock_path             = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] privsep_osbrick.capabilities   = [21] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] privsep_osbrick.group          = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] privsep_osbrick.helper_command = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] privsep_osbrick.user           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] nova_sys_admin.group           = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] nova_sys_admin.helper_command  = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] nova_sys_admin.user            = None {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG oslo_service.service [None req-cf303c7c-bb02-49c8-a33d-4a79f6691dba None None] ******************************************************************************** {{(pid=74870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 06:34:04 user nova-compute[74870]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Connecting to libvirt: qemu:///system {{(pid=74870) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fcefd0f63e0> {{(pid=74870) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 06:34:04 user nova-compute[74870]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 06:34:04 user nova-compute[74870]: WARNING nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fcefd0f63e0> {{(pid=74870) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Starting native event thread {{(pid=74870) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Starting green dispatch thread {{(pid=74870) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Starting connection event dispatch thread {{(pid=74870) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 06:34:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Connection event '1' reason 'None'
Nov 28 06:34:04 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 06:34:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.mount [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Initialising _HostMountState generation 0 {{(pid=74870) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 06:34:11 user nova-compute[74870]: INFO nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host capabilities <capabilities>
Nov 28 06:34:11 user nova-compute[74870]:   <host>
Nov 28 06:34:11 user nova-compute[74870]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 06:34:11 user nova-compute[74870]:     <cpu>
Nov 28 06:34:11 user nova-compute[74870]:       <arch>x86_64</arch>
Nov 28 06:34:11 user nova-compute[74870]:       <model>IvyBridge-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:11 user nova-compute[74870]:       <microcode version='1070'/>
Nov 28 06:34:11 user nova-compute[74870]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 06:34:11 user nova-compute[74870]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='ss'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='vmx'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='pcid'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='osxsave'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='hypervisor'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='arat'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='tsc_adjust'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='md-clear'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='stibp'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='arch-capabilities'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='ssbd'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='invtsc'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='rsba'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 06:34:11 user nova-compute[74870]:       <pages unit='KiB' size='4'/>
Nov 28 06:34:11 user nova-compute[74870]:       <pages unit='KiB' size='2048'/>
Nov 28 06:34:11 user nova-compute[74870]:     </cpu>
Nov 28 06:34:11 user nova-compute[74870]:     <power_management>
Nov 28 06:34:11 user nova-compute[74870]:       <suspend_mem/>
Nov 28 06:34:11 user nova-compute[74870]:       <suspend_disk/>
Nov 28 06:34:11 user nova-compute[74870]:       <suspend_hybrid/>
Nov 28 06:34:11 user nova-compute[74870]:     </power_management>
Nov 28 06:34:11 user nova-compute[74870]:     <iommu support='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     <migration_features>
Nov 28 06:34:11 user nova-compute[74870]:       <live/>
Nov 28 06:34:11 user nova-compute[74870]:       <uri_transports>
Nov 28 06:34:11 user nova-compute[74870]:         <uri_transport>tcp</uri_transport>
Nov 28 06:34:11 user nova-compute[74870]:         <uri_transport>rdma</uri_transport>
Nov 28 06:34:11 user nova-compute[74870]:       </uri_transports>
Nov 28 06:34:11 user nova-compute[74870]:     </migration_features>
Nov 28 06:34:11 user nova-compute[74870]:     <topology>
Nov 28 06:34:11 user nova-compute[74870]:       <cells num='2'>
Nov 28 06:34:11 user nova-compute[74870]:         <cell id='0'>
Nov 28 06:34:11 user nova-compute[74870]:           <memory unit='KiB'>8140616</memory>
Nov 28 06:34:11 user nova-compute[74870]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 28 06:34:11 user nova-compute[74870]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 06:34:11 user nova-compute[74870]:           <distances>
Nov 28 06:34:11 user nova-compute[74870]:             <sibling id='0' value='10'/>
Nov 28 06:34:11 user nova-compute[74870]:             <sibling id='1' value='20'/>
Nov 28 06:34:11 user nova-compute[74870]:           </distances>
Nov 28 06:34:11 user nova-compute[74870]:           <cpus num='6'>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 06:34:11 user nova-compute[74870]:           </cpus>
Nov 28 06:34:11 user nova-compute[74870]:         </cell>
Nov 28 06:34:11 user nova-compute[74870]:         <cell id='1'>
Nov 28 06:34:11 user nova-compute[74870]:           <memory unit='KiB'>8255100</memory>
Nov 28 06:34:11 user nova-compute[74870]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 28 06:34:11 user nova-compute[74870]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 06:34:11 user nova-compute[74870]:           <distances>
Nov 28 06:34:11 user nova-compute[74870]:             <sibling id='0' value='20'/>
Nov 28 06:34:11 user nova-compute[74870]:             <sibling id='1' value='10'/>
Nov 28 06:34:11 user nova-compute[74870]:           </distances>
Nov 28 06:34:11 user nova-compute[74870]:           <cpus num='6'>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 06:34:11 user nova-compute[74870]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 06:34:11 user nova-compute[74870]:           </cpus>
Nov 28 06:34:11 user nova-compute[74870]:         </cell>
Nov 28 06:34:11 user nova-compute[74870]:       </cells>
Nov 28 06:34:11 user nova-compute[74870]:     </topology>
Nov 28 06:34:11 user nova-compute[74870]:     <cache>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 06:34:11 user nova-compute[74870]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 06:34:11 user nova-compute[74870]:     </cache>
Nov 28 06:34:11 user nova-compute[74870]:     <secmodel>
Nov 28 06:34:11 user nova-compute[74870]:       <model>apparmor</model>
Nov 28 06:34:11 user nova-compute[74870]:       <doi>0</doi>
Nov 28 06:34:11 user nova-compute[74870]:     </secmodel>
Nov 28 06:34:11 user nova-compute[74870]:     <secmodel>
Nov 28 06:34:11 user nova-compute[74870]:       <model>dac</model>
Nov 28 06:34:11 user nova-compute[74870]:       <doi>0</doi>
Nov 28 06:34:11 user nova-compute[74870]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 06:34:11 user nova-compute[74870]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 06:34:11 user nova-compute[74870]:     </secmodel>
Nov 28 06:34:11 user nova-compute[74870]:   </host>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='alpha'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>clipper</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='armv6l'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>spitz</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>nuri</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>kzm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sx1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>z2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>tosa</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>n810</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>n800</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>terrier</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>midway</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>microbit</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>verdex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>highbank</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>akita</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>connex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>collie</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='armv7l'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>spitz</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>nuri</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>kzm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sx1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>z2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>tosa</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>n810</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>n800</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>terrier</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>midway</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>microbit</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>verdex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>highbank</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>akita</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>connex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>collie</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='aarch64'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>spitz</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>nuri</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>kzm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sx1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>z2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>tosa</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>n810</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>n800</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>terrier</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>midway</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>microbit</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>verdex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>highbank</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>akita</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>connex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>collie</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <acpi default='on' toggle='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='cris'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='i686'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>isapc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>microvm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='kvm'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <pae/>
Nov 28 06:34:11 user nova-compute[74870]:       <nonpae/>
Nov 28 06:34:11 user nova-compute[74870]:       <acpi default='on' toggle='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:       <apic default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='m68k'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>an5206</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>q800</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='microblaze'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='microblazeel'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='mips'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='16'>malta</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='mipsel'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='16'>malta</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='mips64'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='16'>malta</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>pica61</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>magnum</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='mips64el'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='16'>malta</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>pica61</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>magnum</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='16'>boston</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='ppc'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mac99</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>40p</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>taihu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='ppc64'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>taihu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>40p</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mac99</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='ppc64le'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>taihu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>40p</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>mac99</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='riscv32'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='8'>spike</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='8'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='riscv64'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='8'>spike</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='8'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='s390x'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='sh4'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>shix</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>r2d</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='sh4eb'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>shix</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>r2d</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='sparc'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>LX</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='sparc64'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>niagara</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='x86_64'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>64</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='1'>isapc</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>microvm</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='kvm'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <acpi default='on' toggle='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:       <apic default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='xtensa'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>sim</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>kc705</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ml605</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx200</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx60</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]:   <guest>
Nov 28 06:34:11 user nova-compute[74870]:     <os_type>hvm</os_type>
Nov 28 06:34:11 user nova-compute[74870]:     <arch name='xtensaeb'>
Nov 28 06:34:11 user nova-compute[74870]:       <wordsize>32</wordsize>
Nov 28 06:34:11 user nova-compute[74870]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='4'>sim</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>kc705</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ml605</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>virt</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx200</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>lx60</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 06:34:11 user nova-compute[74870]:       <domain type='qemu'/>
Nov 28 06:34:11 user nova-compute[74870]:     </arch>
Nov 28 06:34:11 user nova-compute[74870]:     <features>
Nov 28 06:34:11 user nova-compute[74870]:       <cpuselection/>
Nov 28 06:34:11 user nova-compute[74870]:       <deviceboot/>
Nov 28 06:34:11 user nova-compute[74870]:       <disksnapshot default='on' toggle='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     </features>
Nov 28 06:34:11 user nova-compute[74870]:   </guest>
Nov 28 06:34:11 user nova-compute[74870]: </capabilities>
Nov 28 06:34:11 user nova-compute[74870]: 
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 06:34:11 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:11 user nova-compute[74870]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 06:34:11 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:11 user nova-compute[74870]:   <machine>pc-q35-jammy</machine>
Nov 28 06:34:11 user nova-compute[74870]:   <arch>i686</arch>
Nov 28 06:34:11 user nova-compute[74870]:   <vcpu max='288'/>
Nov 28 06:34:11 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:     <enum name='firmware'/>
Nov 28 06:34:11 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 06:34:11 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 06:34:11 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 06:34:11 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 06:34:11 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </loader>
Nov 28 06:34:11 user nova-compute[74870]:   </os>
Nov 28 06:34:11 user nova-compute[74870]:   <cpu>
Nov 28 06:34:11 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </mode>
Nov 28 06:34:11 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </mode>
Nov 28 06:34:11 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:11 user nova-compute[74870]:       <feature policy='disable' name='lm'/>
Nov 28 06:34:11 user nova-compute[74870]:     </mode>
Nov 28 06:34:11 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>kvm64</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>core2duo</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Westmere</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Penryn</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Opteron_G1</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Nehalem</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Conroe</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:11 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:11 user nova-compute[74870]:     </mode>
Nov 28 06:34:11 user nova-compute[74870]:   </cpu>
Nov 28 06:34:11 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:11 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:11 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:11 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:11 user nova-compute[74870]:     </enum>
Nov 28 06:34:11 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:11 user nova-compute[74870]:   <devices>
Nov 28 06:34:11 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </disk>
Nov 28 06:34:11 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </graphics>
Nov 28 06:34:11 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </video>
Nov 28 06:34:11 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:11 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:11 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </rng>
Nov 28 06:34:11 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:11 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:11 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:11 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:11 user nova-compute[74870]:       </enum>
Nov 28 06:34:11 user nova-compute[74870]:     </tpm>
Nov 28 06:34:11 user nova-compute[74870]:   </devices>
Nov 28 06:34:11 user nova-compute[74870]:   <features>
Nov 28 06:34:11 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:11 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:11 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:11 user nova-compute[74870]:   </features>
Nov 28 06:34:11 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:11 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-i440fx-jammy</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>i686</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='255'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'/>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='lm'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ide</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-i440fx-6.2</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>i686</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='255'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'/>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='lm'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ide</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-q35-6.2</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>i686</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='288'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'/>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='lm'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-q35-jammy</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>x86_64</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='288'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>efi</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='invtsc'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='rsba'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-i440fx-jammy</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>x86_64</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='255'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>efi</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='invtsc'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='rsba'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ide</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-i440fx-6.2</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>x86_64</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='255'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>efi</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='invtsc'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='rsba'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ide</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 06:34:12 user nova-compute[74870]: <domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 06:34:12 user nova-compute[74870]:   <domain>kvm</domain>
Nov 28 06:34:12 user nova-compute[74870]:   <machine>pc-q35-6.2</machine>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>x86_64</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <vcpu max='288'/>
Nov 28 06:34:12 user nova-compute[74870]:   <iothreads supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:   <os supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='firmware'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>efi</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:     <loader supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>rom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pflash</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='readonly'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='secure'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>yes</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>no</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </loader>
Nov 28 06:34:12 user nova-compute[74870]:   </os>
Nov 28 06:34:12 user nova-compute[74870]:   <cpu>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-passthrough' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='hostPassthroughMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='maximum' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='maximumMigratable'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>on</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>off</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='host-model' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ss'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='vmx'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pcid'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='hypervisor'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arat'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='umip'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='md-clear'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='invtsc'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibpb'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='ibrs'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-stibp'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='rsba'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='erms'/>
Nov 28 06:34:12 user nova-compute[74870]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:     <mode name='custom' supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>qemu64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>qemu32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>phenom</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>pentium</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>n270</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm64</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>kvm32</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>coreduo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>core2duo</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>athlon</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Westmere</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Snowridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Skylake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>SandyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Penryn</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G5</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G4</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G3</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Opteron_G2</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Opteron_G1</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>IvyBridge</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Icelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Haswell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Rome</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-Milan</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>EPYC</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Dhyana</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cooperlake</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>Conroe</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='no'>Broadwell</model>
Nov 28 06:34:12 user nova-compute[74870]:       <model usable='yes'>486</model>
Nov 28 06:34:12 user nova-compute[74870]:     </mode>
Nov 28 06:34:12 user nova-compute[74870]:   </cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <memoryBacking supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:     <enum name='sourceType'>
Nov 28 06:34:12 user nova-compute[74870]:       <value>file</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>anonymous</value>
Nov 28 06:34:12 user nova-compute[74870]:       <value>memfd</value>
Nov 28 06:34:12 user nova-compute[74870]:     </enum>
Nov 28 06:34:12 user nova-compute[74870]:   </memoryBacking>
Nov 28 06:34:12 user nova-compute[74870]:   <devices>
Nov 28 06:34:12 user nova-compute[74870]:     <disk supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='diskDevice'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>disk</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cdrom</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>floppy</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>lun</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='bus'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>fdc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sata</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </disk>
Nov 28 06:34:12 user nova-compute[74870]:     <graphics supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='type'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>sdl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vnc</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>spice</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egl-headless</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </graphics>
Nov 28 06:34:12 user nova-compute[74870]:     <video supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='modelType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>cirrus</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>vmvga</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>qxl</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>none</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>bochs</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>ramfb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </video>
Nov 28 06:34:12 user nova-compute[74870]:     <hostdev supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='mode'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>subsystem</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='startupPolicy'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>default</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>mandatory</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>requisite</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>optional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='subsysType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>usb</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>pci</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>scsi</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='capsType'/>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='pciBackend'/>
Nov 28 06:34:12 user nova-compute[74870]:     </hostdev>
Nov 28 06:34:12 user nova-compute[74870]:     <rng supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtio-non-transitional</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>random</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>egd</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>builtin</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </rng>
Nov 28 06:34:12 user nova-compute[74870]:     <filesystem supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='driverType'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>path</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>handle</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>virtiofs</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </filesystem>
Nov 28 06:34:12 user nova-compute[74870]:     <tpm supported='yes'>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='model'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-tis</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>tpm-crb</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:       <enum name='backendModel'>
Nov 28 06:34:12 user nova-compute[74870]:         <value>passthrough</value>
Nov 28 06:34:12 user nova-compute[74870]:         <value>emulator</value>
Nov 28 06:34:12 user nova-compute[74870]:       </enum>
Nov 28 06:34:12 user nova-compute[74870]:     </tpm>
Nov 28 06:34:12 user nova-compute[74870]:   </devices>
Nov 28 06:34:12 user nova-compute[74870]:   <features>
Nov 28 06:34:12 user nova-compute[74870]:     <gic supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:     <vmcoreinfo supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <genid supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backingStoreInput supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <backup supported='yes'/>
Nov 28 06:34:12 user nova-compute[74870]:     <sev supported='no'/>
Nov 28 06:34:12 user nova-compute[74870]:   </features>
Nov 28 06:34:12 user nova-compute[74870]: </domainCapabilities>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Checking secure boot support for host arch (x86_64) {{(pid=74870) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Secure Boot support detected
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] cpu compare xml: <cpu match="exact">
Nov 28 06:34:12 user nova-compute[74870]:   <model>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]: </cpu>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.virt.node [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Generated node identity 815baae3-b790-4d61-806d-4eb5745b5a72
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.virt.node [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Wrote node identity 815baae3-b790-4d61-806d-4eb5745b5a72 to /opt/stack/data/nova/compute_id
Nov 28 06:34:12 user nova-compute[74870]: WARNING nova.compute.manager [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Compute nodes ['815baae3-b790-4d61-806d-4eb5745b5a72'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.compute.manager [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 06:34:12 user nova-compute[74870]: WARNING nova.compute.manager [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 06:34:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:34:12 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:34:12 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Hypervisor/Node resource view: name=user free_ram=10943MB free_disk=26.325927734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:34:12 user nova-compute[74870]: WARNING nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] No compute node record for user:815baae3-b790-4d61-806d-4eb5745b5a72: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 815baae3-b790-4d61-806d-4eb5745b5a72 could not be found.
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Compute node record created for user:user with uuid: 815baae3-b790-4d61-806d-4eb5745b5a72
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] [req-4f007b7c-241b-4a50-a7df-0fa385286e8c] Created resource provider record via placement API for resource provider with UUID 815baae3-b790-4d61-806d-4eb5745b5a72 and name user.
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74870) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 06:34:12 user nova-compute[74870]: INFO nova.virt.libvirt.host [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] kernel doesn't support AMD SEV
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Libvirt baseline CPU <cpu>
Nov 28 06:34:12 user nova-compute[74870]:   <arch>x86_64</arch>
Nov 28 06:34:12 user nova-compute[74870]:   <model>Nehalem</model>
Nov 28 06:34:12 user nova-compute[74870]:   <vendor>Intel</vendor>
Nov 28 06:34:12 user nova-compute[74870]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 06:34:12 user nova-compute[74870]: </cpu>
Nov 28 06:34:12 user nova-compute[74870]:  {{(pid=74870) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Updated inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Updating resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 generation from 0 to 1 during operation: update_inventory {{(pid=74870) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 06:34:12 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 06:34:13 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Updating resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 generation from 1 to 2 during operation: update_traits {{(pid=74870) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 06:34:13 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:34:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:34:13 user nova-compute[74870]: DEBUG nova.service [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Creating RPC server for service compute {{(pid=74870) start /opt/stack/nova/nova/service.py:182}}
Nov 28 06:34:13 user nova-compute[74870]: DEBUG nova.service [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] Join ServiceGroup membership for this service compute {{(pid=74870) start /opt/stack/nova/nova/service.py:199}}
Nov 28 06:34:13 user nova-compute[74870]: DEBUG nova.servicegroup.drivers.db [None req-ece962cc-6c79-41d6-b36f-d41ecdc8f1f3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74870) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 06:34:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:34:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:35:04 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:35:04 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.229602813720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:35:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:36:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:05 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:05 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:05 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:36:06 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:36:06 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=26.29413604736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:36:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:07 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:37:08 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:37:08 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=10338MB free_disk=26.04629135131836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:37:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:38:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:38:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:38:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:38:09 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:09 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=9593MB free_disk=26.066864013671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:38:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:11 user nova-compute[74870]: INFO nova.compute.claims [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Claim successful on node user
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:12 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Creating image(s)
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG nova.policy [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG nova.virt.images [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] f62a76e5-f00c-416b-84d0-db9b754396ab was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.part /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.part /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.converted" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.116s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:13 user nova-compute[74870]: INFO oslo.privsep.daemon [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8l7_z6cl/privsep.sock']
Nov 28 06:38:13 user sudo[84120]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8l7_z6cl/privsep.sock
Nov 28 06:38:13 user sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 06:38:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:13 user nova-compute[74870]: INFO nova.compute.claims [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Claim successful on node user
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.105s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:14 user nova-compute[74870]: INFO nova.compute.claims [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Claim successful on node user
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Successfully created port: 63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Creating image(s)
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.policy [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:14 user sudo[84120]: pam_unix(sudo:session): session closed for user root
Nov 28 06:38:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:14 user nova-compute[74870]: INFO oslo.privsep.daemon [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Spawned new privsep daemon via rootwrap
Nov 28 06:38:14 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 06:38:14 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 06:38:14 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 06:38:14 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84132
Nov 28 06:38:14 user nova-compute[74870]: WARNING oslo_privsep.priv_context [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] privsep daemon already running
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:15 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Creating image(s)
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "/opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "/opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.164s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.policy [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk 1073741824" returned: 0 in 0.075s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.274s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.240s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk 1073741824" returned: 0 in 0.072s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.543s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Cannot resize image /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Ensure instance console log exists: /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.228s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk 1073741824" returned: 0 in 0.041s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Cannot resize image /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Ensure instance console log exists: /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:16 user nova-compute[74870]: INFO nova.compute.claims [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Claim successful on node user
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Cannot resize image /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Successfully created port: ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Creating image(s)
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.policy [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.167s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.164s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk 1073741824" returned: 0 in 0.067s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Cannot resize image /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Ensure instance console log exists: /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Successfully updated port: 63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:17 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-changed-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Refreshing instance network info cache due to event network-changed-63ce66df-1214-4fbb-a8f5-8d08c9fb640f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Acquiring lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Successfully created port: 505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:19 user nova-compute[74870]: INFO nova.compute.claims [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Claim successful on node user
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance network_info: |[{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Acquired lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Refreshing network info cache for port 63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Start _get_guest_xml network_info=[{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Successfully created port: f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:19 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:19 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-863344240',display_name='tempest-ServerRescueNegativeTestJSON-server-863344240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-863344240',id=1,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-3lv7qxhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:12Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=37549ec7-6ded-412f-8a4f-58a7469e4cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'pci_devices' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:19 user nova-compute[74870]:   <uuid>37549ec7-6ded-412f-8a4f-58a7469e4cd1</uuid>
Nov 28 06:38:19 user nova-compute[74870]:   <name>instance-00000001</name>
Nov 28 06:38:19 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:19 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:19 user nova-compute[74870]:   <metadata>
Nov 28 06:38:19 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:19 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:19 user nova-compute[74870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-863344240</nova:name>
Nov 28 06:38:19 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:19</nova:creationTime>
Nov 28 06:38:19 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:19 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:19 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:19 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:user uuid="109001cce8ec4aa0b87f271b415cd5e6">tempest-ServerRescueNegativeTestJSON-226827849-project-member</nova:user>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:project uuid="8f90603ba77644568ec6f6fd37689a08">tempest-ServerRescueNegativeTestJSON-226827849</nova:project>
Nov 28 06:38:19 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:19 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:19 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:19 user nova-compute[74870]:         <nova:port uuid="63ce66df-1214-4fbb-a8f5-8d08c9fb640f">
Nov 28 06:38:19 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 06:38:19 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:19 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:19 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:19 user nova-compute[74870]:   </metadata>
Nov 28 06:38:19 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:19 user nova-compute[74870]:     <system>
Nov 28 06:38:19 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:19 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:19 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:19 user nova-compute[74870]:       <entry name="serial">37549ec7-6ded-412f-8a4f-58a7469e4cd1</entry>
Nov 28 06:38:19 user nova-compute[74870]:       <entry name="uuid">37549ec7-6ded-412f-8a4f-58a7469e4cd1</entry>
Nov 28 06:38:19 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:19 user nova-compute[74870]:     </system>
Nov 28 06:38:19 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:19 user nova-compute[74870]:   <os>
Nov 28 06:38:19 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:19 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:19 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:19 user nova-compute[74870]:   </os>
Nov 28 06:38:19 user nova-compute[74870]:   <features>
Nov 28 06:38:19 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:19 user nova-compute[74870]:     <apic/>
Nov 28 06:38:19 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:19 user nova-compute[74870]:   </features>
Nov 28 06:38:19 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:19 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:19 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:19 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:19 user nova-compute[74870]:   </clock>
Nov 28 06:38:19 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:19 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:19 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:19 user nova-compute[74870]:   </cpu>
Nov 28 06:38:19 user nova-compute[74870]:   <devices>
Nov 28 06:38:19 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:19 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:19 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk"/>
Nov 28 06:38:19 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:19 user nova-compute[74870]:     </disk>
Nov 28 06:38:19 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:19 user nova-compute[74870]:       <mac address="fa:16:3e:c3:cb:4e"/>
Nov 28 06:38:19 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:19 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:19 user nova-compute[74870]:       <target dev="tap63ce66df-12"/>
Nov 28 06:38:19 user nova-compute[74870]:     </interface>
Nov 28 06:38:19 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:19 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/console.log" append="off"/>
Nov 28 06:38:19 user nova-compute[74870]:     </serial>
Nov 28 06:38:19 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:19 user nova-compute[74870]:     <video>
Nov 28 06:38:19 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:19 user nova-compute[74870]:     </video>
Nov 28 06:38:19 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:19 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:19 user nova-compute[74870]:     </rng>
Nov 28 06:38:19 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:19 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:19 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:19 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:19 user nova-compute[74870]:   </devices>
Nov 28 06:38:19 user nova-compute[74870]: </domain>
Nov 28 06:38:19 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-863344240',display_name='tempest-ServerRescueNegativeTestJSON-server-863344240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-863344240',id=1,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-3lv7qxhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:12Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=37549ec7-6ded-412f-8a4f-58a7469e4cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG os_vif [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Created schema index Interface.name {{(pid=74870) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Created schema index Port.name {{(pid=74870) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Created schema index Bridge.name {{(pid=74870) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [POLLOUT] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35fbd8f1-4b47-5749-8b6a-3670047bab00', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:19 user nova-compute[74870]: INFO oslo.privsep.daemon [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpgbf9lfcs/privsep.sock']
Nov 28 06:38:19 user sudo[84202]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpgbf9lfcs/privsep.sock
Nov 28 06:38:19 user sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Creating image(s)
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG nova.policy [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.158s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Successfully updated port: ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk 1073741824" returned: 0 in 0.063s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-changed-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Refreshing instance network info cache due to event network-changed-ac8aece2-e749-4b38-8812-e9d4df591f41. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Acquiring lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Cannot resize image /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Ensure instance console log exists: /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:20 user sudo[84202]: pam_unix(sudo:session): session closed for user root
Nov 28 06:38:20 user nova-compute[74870]: INFO oslo.privsep.daemon [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Spawned new privsep daemon via rootwrap
Nov 28 06:38:20 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 06:38:20 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 06:38:20 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 06:38:20 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84220
Nov 28 06:38:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updated VIF entry in instance network info cache for port 63ce66df-1214-4fbb-a8f5-8d08c9fb640f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Releasing lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:21 user nova-compute[74870]: INFO nova.compute.claims [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Claim successful on node user
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Successfully updated port: 505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquired lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Successfully updated port: f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63ce66df-12, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63ce66df-12, col_values=(('qos', UUID('ded64957-fbb6-41c4-a2e7-0afe1388023a')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63ce66df-12, col_values=(('external_ids', {'iface-id': '63ce66df-1214-4fbb-a8f5-8d08c9fb640f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:cb:4e', 'vm-uuid': '37549ec7-6ded-412f-8a4f-58a7469e4cd1'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:21 user nova-compute[74870]: INFO os_vif [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12')
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:c3:cb:4e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Creating image(s)
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.policy [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance network_info: |[{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Acquired lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Refreshing network info cache for port ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Start _get_guest_xml network_info=[{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Received event network-changed-505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Refreshing instance network info cache due to event network-changed-505345c6-a079-468d-be35-64932bcaef25. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Acquiring lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-changed-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Refreshing instance network info cache due to event network-changed-f14d8817-78b1-4d77-b312-3d5ccaab9d4a. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Acquiring lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30674904',display_name='tempest-ServerRescueNegativeTestJSON-server-30674904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30674904',id=2,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-m4bo25mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:15Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=94a8f46d-3105-4486-a8b4-1409c9c544c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.objects.instance [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:21 user nova-compute[74870]:   <uuid>94a8f46d-3105-4486-a8b4-1409c9c544c7</uuid>
Nov 28 06:38:21 user nova-compute[74870]:   <name>instance-00000002</name>
Nov 28 06:38:21 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:21 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:21 user nova-compute[74870]:   <metadata>
Nov 28 06:38:21 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:21 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:21 user nova-compute[74870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-30674904</nova:name>
Nov 28 06:38:21 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:21</nova:creationTime>
Nov 28 06:38:21 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:21 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:21 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:21 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:user uuid="109001cce8ec4aa0b87f271b415cd5e6">tempest-ServerRescueNegativeTestJSON-226827849-project-member</nova:user>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:project uuid="8f90603ba77644568ec6f6fd37689a08">tempest-ServerRescueNegativeTestJSON-226827849</nova:project>
Nov 28 06:38:21 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:21 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:21 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:21 user nova-compute[74870]:         <nova:port uuid="ac8aece2-e749-4b38-8812-e9d4df591f41">
Nov 28 06:38:21 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 06:38:21 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:21 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:21 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:21 user nova-compute[74870]:   </metadata>
Nov 28 06:38:21 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:21 user nova-compute[74870]:     <system>
Nov 28 06:38:21 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:21 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:21 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:21 user nova-compute[74870]:       <entry name="serial">94a8f46d-3105-4486-a8b4-1409c9c544c7</entry>
Nov 28 06:38:21 user nova-compute[74870]:       <entry name="uuid">94a8f46d-3105-4486-a8b4-1409c9c544c7</entry>
Nov 28 06:38:21 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:21 user nova-compute[74870]:     </system>
Nov 28 06:38:21 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:21 user nova-compute[74870]:   <os>
Nov 28 06:38:21 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:21 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:21 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:21 user nova-compute[74870]:   </os>
Nov 28 06:38:21 user nova-compute[74870]:   <features>
Nov 28 06:38:21 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:21 user nova-compute[74870]:     <apic/>
Nov 28 06:38:21 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:21 user nova-compute[74870]:   </features>
Nov 28 06:38:21 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:21 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:21 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:21 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:21 user nova-compute[74870]:   </clock>
Nov 28 06:38:21 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:21 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:21 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:21 user nova-compute[74870]:   </cpu>
Nov 28 06:38:21 user nova-compute[74870]:   <devices>
Nov 28 06:38:21 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:21 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:21 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk"/>
Nov 28 06:38:21 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:21 user nova-compute[74870]:     </disk>
Nov 28 06:38:21 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:21 user nova-compute[74870]:       <mac address="fa:16:3e:35:bc:d7"/>
Nov 28 06:38:21 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:21 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:21 user nova-compute[74870]:       <target dev="tapac8aece2-e7"/>
Nov 28 06:38:21 user nova-compute[74870]:     </interface>
Nov 28 06:38:21 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:21 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/console.log" append="off"/>
Nov 28 06:38:21 user nova-compute[74870]:     </serial>
Nov 28 06:38:21 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:21 user nova-compute[74870]:     <video>
Nov 28 06:38:21 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:21 user nova-compute[74870]:     </video>
Nov 28 06:38:21 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:21 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:21 user nova-compute[74870]:     </rng>
Nov 28 06:38:21 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:21 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:21 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:21 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:21 user nova-compute[74870]:   </devices>
Nov 28 06:38:21 user nova-compute[74870]: </domain>
Nov 28 06:38:21 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30674904',display_name='tempest-ServerRescueNegativeTestJSON-server-30674904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30674904',id=2,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-m4bo25mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:15Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=94a8f46d-3105-4486-a8b4-1409c9c544c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG os_vif [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f223b3f-a62a-5378-984c-ea738c3ca08c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac8aece2-e7, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac8aece2-e7, col_values=(('qos', UUID('2b5b4cb4-ad4f-4148-8008-ea0fbc80f2c9')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac8aece2-e7, col_values=(('external_ids', {'iface-id': 'ac8aece2-e749-4b38-8812-e9d4df591f41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:bc:d7', 'vm-uuid': '94a8f46d-3105-4486-a8b4-1409c9c544c7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:21 user nova-compute[74870]: INFO os_vif [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7')
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:35:bc:d7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk 1073741824" returned: 0 in 0.061s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Cannot resize image /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Ensure instance console log exists: /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updating instance_info_cache with network_info: [{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Instance network_info: |[{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Acquired lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Refreshing network info cache for port f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Start _get_guest_xml network_info=[{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1355811946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1355811946',id=4,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-rdbjf6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:17Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=0b630563-12cc-467d-8908-e2a8fb230b62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b630563-12cc-467d-8908-e2a8fb230b62 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:22 user nova-compute[74870]:   <uuid>0b630563-12cc-467d-8908-e2a8fb230b62</uuid>
Nov 28 06:38:22 user nova-compute[74870]:   <name>instance-00000004</name>
Nov 28 06:38:22 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:22 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:22 user nova-compute[74870]:   <metadata>
Nov 28 06:38:22 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:22 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1355811946</nova:name>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:22</nova:creationTime>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:22 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:22 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:user uuid="c13b793a926942e88fc3416cf3fa005e">tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member</nova:user>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:project uuid="a07e9312175c4e73aa29a51865d61ebd">tempest-ServerBootFromVolumeStableRescueTest-397751332</nova:project>
Nov 28 06:38:22 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:port uuid="f14d8817-78b1-4d77-b312-3d5ccaab9d4a">
Nov 28 06:38:22 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 06:38:22 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:22 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:22 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:22 user nova-compute[74870]:   </metadata>
Nov 28 06:38:22 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:22 user nova-compute[74870]:     <system>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="serial">0b630563-12cc-467d-8908-e2a8fb230b62</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="uuid">0b630563-12cc-467d-8908-e2a8fb230b62</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:22 user nova-compute[74870]:     </system>
Nov 28 06:38:22 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:22 user nova-compute[74870]:   <os>
Nov 28 06:38:22 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:22 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:22 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:22 user nova-compute[74870]:   </os>
Nov 28 06:38:22 user nova-compute[74870]:   <features>
Nov 28 06:38:22 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:22 user nova-compute[74870]:     <apic/>
Nov 28 06:38:22 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:22 user nova-compute[74870]:   </features>
Nov 28 06:38:22 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:22 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:22 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:22 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:22 user nova-compute[74870]:   </clock>
Nov 28 06:38:22 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:22 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:22 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:22 user nova-compute[74870]:   </cpu>
Nov 28 06:38:22 user nova-compute[74870]:   <devices>
Nov 28 06:38:22 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:22 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk"/>
Nov 28 06:38:22 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:22 user nova-compute[74870]:     </disk>
Nov 28 06:38:22 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:22 user nova-compute[74870]:       <mac address="fa:16:3e:45:8b:13"/>
Nov 28 06:38:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:22 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:22 user nova-compute[74870]:       <target dev="tapf14d8817-78"/>
Nov 28 06:38:22 user nova-compute[74870]:     </interface>
Nov 28 06:38:22 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:22 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/console.log" append="off"/>
Nov 28 06:38:22 user nova-compute[74870]:     </serial>
Nov 28 06:38:22 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:22 user nova-compute[74870]:     <video>
Nov 28 06:38:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:22 user nova-compute[74870]:     </video>
Nov 28 06:38:22 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:22 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:22 user nova-compute[74870]:     </rng>
Nov 28 06:38:22 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:22 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:22 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:22 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:22 user nova-compute[74870]:   </devices>
Nov 28 06:38:22 user nova-compute[74870]: </domain>
Nov 28 06:38:22 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1355811946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1355811946',id=4,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-rdbjf6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:17Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=0b630563-12cc-467d-8908-e2a8fb230b62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG os_vif [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94749279-ed4c-508b-90c1-10a4e3a6081c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf14d8817-78, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf14d8817-78, col_values=(('qos', UUID('88a832fb-61b3-4978-98d2-ccbd6656840a')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf14d8817-78, col_values=(('external_ids', {'iface-id': 'f14d8817-78b1-4d77-b312-3d5ccaab9d4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:8b:13', 'vm-uuid': '0b630563-12cc-467d-8908-e2a8fb230b62'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: INFO os_vif [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78')
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Updating instance_info_cache with network_info: [{"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Successfully created port: 1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Releasing lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Instance network_info: |[{"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Acquired lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Refreshing network info cache for port 505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Start _get_guest_xml network_info=[{"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-453551306',display_name='tempest-ServersNegativeTestJSON-server-453551306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-453551306',id=3,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6362608255de47c3afa716e3091af3d0',ramdisk_id='',reservation_id='r-pkp5df1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1666481027',owner_user_name='tempest-ServersNegativeTestJSON-1666481027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:15Z,user_data=None,user_id='5bd89a43a3bf4952a40cd1dd07de2442',uuid=d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converting VIF {"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lazy-loading 'pci_devices' on Instance uuid d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:22 user nova-compute[74870]:   <uuid>d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e</uuid>
Nov 28 06:38:22 user nova-compute[74870]:   <name>instance-00000003</name>
Nov 28 06:38:22 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:22 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:22 user nova-compute[74870]:   <metadata>
Nov 28 06:38:22 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:22 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:name>tempest-ServersNegativeTestJSON-server-453551306</nova:name>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:22</nova:creationTime>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:22 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:22 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:user uuid="5bd89a43a3bf4952a40cd1dd07de2442">tempest-ServersNegativeTestJSON-1666481027-project-member</nova:user>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:project uuid="6362608255de47c3afa716e3091af3d0">tempest-ServersNegativeTestJSON-1666481027</nova:project>
Nov 28 06:38:22 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:22 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:22 user nova-compute[74870]:         <nova:port uuid="505345c6-a079-468d-be35-64932bcaef25">
Nov 28 06:38:22 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 06:38:22 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:22 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:22 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:22 user nova-compute[74870]:   </metadata>
Nov 28 06:38:22 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:22 user nova-compute[74870]:     <system>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="serial">d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="uuid">d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e</entry>
Nov 28 06:38:22 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:22 user nova-compute[74870]:     </system>
Nov 28 06:38:22 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:22 user nova-compute[74870]:   <os>
Nov 28 06:38:22 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:22 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:22 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:22 user nova-compute[74870]:   </os>
Nov 28 06:38:22 user nova-compute[74870]:   <features>
Nov 28 06:38:22 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:22 user nova-compute[74870]:     <apic/>
Nov 28 06:38:22 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:22 user nova-compute[74870]:   </features>
Nov 28 06:38:22 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:22 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:22 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:22 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:22 user nova-compute[74870]:   </clock>
Nov 28 06:38:22 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:22 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:22 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:22 user nova-compute[74870]:   </cpu>
Nov 28 06:38:22 user nova-compute[74870]:   <devices>
Nov 28 06:38:22 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:22 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk"/>
Nov 28 06:38:22 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:22 user nova-compute[74870]:     </disk>
Nov 28 06:38:22 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:22 user nova-compute[74870]:       <mac address="fa:16:3e:e1:d2:3e"/>
Nov 28 06:38:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:22 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:22 user nova-compute[74870]:       <target dev="tap505345c6-a0"/>
Nov 28 06:38:22 user nova-compute[74870]:     </interface>
Nov 28 06:38:22 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:22 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/console.log" append="off"/>
Nov 28 06:38:22 user nova-compute[74870]:     </serial>
Nov 28 06:38:22 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:22 user nova-compute[74870]:     <video>
Nov 28 06:38:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:22 user nova-compute[74870]:     </video>
Nov 28 06:38:22 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:22 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:22 user nova-compute[74870]:     </rng>
Nov 28 06:38:22 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:22 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:22 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:22 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:22 user nova-compute[74870]:   </devices>
Nov 28 06:38:22 user nova-compute[74870]: </domain>
Nov 28 06:38:22 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-453551306',display_name='tempest-ServersNegativeTestJSON-server-453551306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-453551306',id=3,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6362608255de47c3afa716e3091af3d0',ramdisk_id='',reservation_id='r-pkp5df1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1666481027',owner_user_name='tempest-ServersNegativeTestJSON-1666481027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:15Z,user_data=None,user_id='5bd89a43a3bf4952a40cd1dd07de2442',uuid=d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converting VIF {"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG os_vif [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3616df7b-a1bb-50a1-85c1-759d165683fb', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No VIF found with MAC fa:16:3e:45:8b:13, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap505345c6-a0, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap505345c6-a0, col_values=(('qos', UUID('d9fe8217-cd62-46f9-9c34-6e2ed3d3e3d0')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap505345c6-a0, col_values=(('external_ids', {'iface-id': '505345c6-a079-468d-be35-64932bcaef25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:d2:3e', 'vm-uuid': 'd3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: INFO os_vif [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0')
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] No VIF found with MAC fa:16:3e:e1:d2:3e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Successfully created port: 717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updated VIF entry in instance network info cache for port ac8aece2-e749-4b38-8812-e9d4df591f41. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Releasing lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updated VIF entry in instance network info cache for port f14d8817-78b1-4d77-b312-3d5ccaab9d4a. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updating instance_info_cache with network_info: [{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Releasing lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Updated VIF entry in instance network info cache for port 505345c6-a079-468d-be35-64932bcaef25. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Updating instance_info_cache with network_info: [{"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Releasing lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Successfully updated port: 1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquired lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-changed-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Refreshing instance network info cache due to event network-changed-1a2f08f7-ca07-4148-a3d9-a9034157bd6a. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Acquiring lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Successfully updated port: 717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-changed-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Refreshing instance network info cache due to event network-changed-717f616f-b485-4c7e-83be-a80086c19692. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:26 user nova-compute[74870]: INFO nova.compute.claims [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Claim successful on node user
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updating instance_info_cache with network_info: [{"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Releasing lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Instance network_info: |[{"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Acquired lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.neutron [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Refreshing network info cache for port 1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Start _get_guest_xml network_info=[{"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1388737861',display_name='tempest-AttachVolumeNegativeTest-server-1388737861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1388737861',id=5,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqYtsHqlq6UKTcER/k64lfbXh2pA9vJqnA4e6c2hp60qQnuBhq6XBV/hxrGLANQCI7nGeXEsElJ+UTUn1LBk09Vnw0+lDPP3HxcBU8qrbayCFVs/OVYsCYO8uUsYj85OA==',key_name='tempest-keypair-894833367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-3mjoe57e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=b4802806-6422-46da-8d0f-5674af0a8433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'pci_devices' on Instance uuid b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:26 user nova-compute[74870]:   <uuid>b4802806-6422-46da-8d0f-5674af0a8433</uuid>
Nov 28 06:38:26 user nova-compute[74870]:   <name>instance-00000005</name>
Nov 28 06:38:26 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:26 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:26 user nova-compute[74870]:   <metadata>
Nov 28 06:38:26 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:26 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:26 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1388737861</nova:name>
Nov 28 06:38:26 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:26</nova:creationTime>
Nov 28 06:38:26 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:26 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:26 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:26 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:user uuid="05e396090c4b4a8995d8d2e66c8b3db0">tempest-AttachVolumeNegativeTest-538884229-project-member</nova:user>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:project uuid="5df9ec769206481e8dad48a6461c46ba">tempest-AttachVolumeNegativeTest-538884229</nova:project>
Nov 28 06:38:26 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:26 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:26 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:26 user nova-compute[74870]:         <nova:port uuid="1a2f08f7-ca07-4148-a3d9-a9034157bd6a">
Nov 28 06:38:26 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 06:38:26 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:26 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:26 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:26 user nova-compute[74870]:   </metadata>
Nov 28 06:38:26 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:26 user nova-compute[74870]:     <system>
Nov 28 06:38:26 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:26 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:26 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:26 user nova-compute[74870]:       <entry name="serial">b4802806-6422-46da-8d0f-5674af0a8433</entry>
Nov 28 06:38:26 user nova-compute[74870]:       <entry name="uuid">b4802806-6422-46da-8d0f-5674af0a8433</entry>
Nov 28 06:38:26 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:26 user nova-compute[74870]:     </system>
Nov 28 06:38:26 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:26 user nova-compute[74870]:   <os>
Nov 28 06:38:26 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:26 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:26 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:26 user nova-compute[74870]:   </os>
Nov 28 06:38:26 user nova-compute[74870]:   <features>
Nov 28 06:38:26 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:26 user nova-compute[74870]:     <apic/>
Nov 28 06:38:26 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:26 user nova-compute[74870]:   </features>
Nov 28 06:38:26 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:26 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:26 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:26 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:26 user nova-compute[74870]:   </clock>
Nov 28 06:38:26 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:26 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:26 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:26 user nova-compute[74870]:   </cpu>
Nov 28 06:38:26 user nova-compute[74870]:   <devices>
Nov 28 06:38:26 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:26 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:26 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk"/>
Nov 28 06:38:26 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:26 user nova-compute[74870]:     </disk>
Nov 28 06:38:26 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:26 user nova-compute[74870]:       <mac address="fa:16:3e:1b:24:e7"/>
Nov 28 06:38:26 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:26 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:26 user nova-compute[74870]:       <target dev="tap1a2f08f7-ca"/>
Nov 28 06:38:26 user nova-compute[74870]:     </interface>
Nov 28 06:38:26 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:26 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/console.log" append="off"/>
Nov 28 06:38:26 user nova-compute[74870]:     </serial>
Nov 28 06:38:26 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:26 user nova-compute[74870]:     <video>
Nov 28 06:38:26 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:26 user nova-compute[74870]:     </video>
Nov 28 06:38:26 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:26 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:26 user nova-compute[74870]:     </rng>
Nov 28 06:38:26 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:26 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:26 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:26 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:26 user nova-compute[74870]:   </devices>
Nov 28 06:38:26 user nova-compute[74870]: </domain>
Nov 28 06:38:26 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1388737861',display_name='tempest-AttachVolumeNegativeTest-server-1388737861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1388737861',id=5,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqYtsHqlq6UKTcER/k64lfbXh2pA9vJqnA4e6c2hp60qQnuBhq6XBV/hxrGLANQCI7nGeXEsElJ+UTUn1LBk09Vnw0+lDPP3HxcBU8qrbayCFVs/OVYsCYO8uUsYj85OA==',key_name='tempest-keypair-894833367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-3mjoe57e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=b4802806-6422-46da-8d0f-5674af0a8433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG os_vif [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ff89682-8d3d-55a0-934f-69b256780751', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a2f08f7-ca, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a2f08f7-ca, col_values=(('qos', UUID('9f7ff85f-85d1-4d81-9486-c9054a636fd2')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a2f08f7-ca, col_values=(('external_ids', {'iface-id': '1a2f08f7-ca07-4148-a3d9-a9034157bd6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:24:e7', 'vm-uuid': 'b4802806-6422-46da-8d0f-5674af0a8433'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:26 user nova-compute[74870]: INFO os_vif [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca')
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:1b:24:e7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Creating image(s)
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.policy [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance network_info: |[{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Refreshing network info cache for port 717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start _get_guest_xml network_info=[{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk 1073741824" returned: 0 in 0.075s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Cannot resize image /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Ensure instance console log exists: /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updated VIF entry in instance network info cache for port 1a2f08f7-ca07-4148-a3d9-a9034157bd6a. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updating instance_info_cache with network_info: [{"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Releasing lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updated VIF entry in instance network info cache for port 717f616f-b485-4c7e-83be-a80086c19692. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Successfully created port: d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance spawned successfully.
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'pci_devices' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:30 user nova-compute[74870]:   <uuid>41240cc1-28a3-4685-9f80-68f5e37945b7</uuid>
Nov 28 06:38:30 user nova-compute[74870]:   <name>instance-00000006</name>
Nov 28 06:38:30 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:30 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:30 user nova-compute[74870]:   <metadata>
Nov 28 06:38:30 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:30 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:30 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherB-server-1411738955</nova:name>
Nov 28 06:38:30 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:30</nova:creationTime>
Nov 28 06:38:30 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:30 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:30 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:30 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:user uuid="18ee95f099b64968984fd3b9e418b048">tempest-ServerActionsTestOtherB-1422366079-project-member</nova:user>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:project uuid="739e836995bb4af6a877468ec43d0cf3">tempest-ServerActionsTestOtherB-1422366079</nova:project>
Nov 28 06:38:30 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:30 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:30 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:30 user nova-compute[74870]:         <nova:port uuid="717f616f-b485-4c7e-83be-a80086c19692">
Nov 28 06:38:30 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 06:38:30 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:30 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:30 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:30 user nova-compute[74870]:   </metadata>
Nov 28 06:38:30 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:30 user nova-compute[74870]:     <system>
Nov 28 06:38:30 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:30 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:30 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:30 user nova-compute[74870]:       <entry name="serial">41240cc1-28a3-4685-9f80-68f5e37945b7</entry>
Nov 28 06:38:30 user nova-compute[74870]:       <entry name="uuid">41240cc1-28a3-4685-9f80-68f5e37945b7</entry>
Nov 28 06:38:30 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:30 user nova-compute[74870]:     </system>
Nov 28 06:38:30 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:30 user nova-compute[74870]:   <os>
Nov 28 06:38:30 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:30 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:30 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:30 user nova-compute[74870]:   </os>
Nov 28 06:38:30 user nova-compute[74870]:   <features>
Nov 28 06:38:30 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:30 user nova-compute[74870]:     <apic/>
Nov 28 06:38:30 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:30 user nova-compute[74870]:   </features>
Nov 28 06:38:30 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:30 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:30 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:30 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:30 user nova-compute[74870]:   </clock>
Nov 28 06:38:30 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:30 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:30 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:30 user nova-compute[74870]:   </cpu>
Nov 28 06:38:30 user nova-compute[74870]:   <devices>
Nov 28 06:38:30 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:30 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:30 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk"/>
Nov 28 06:38:30 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:30 user nova-compute[74870]:     </disk>
Nov 28 06:38:30 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:30 user nova-compute[74870]:       <mac address="fa:16:3e:dd:63:14"/>
Nov 28 06:38:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:30 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:30 user nova-compute[74870]:       <target dev="tap717f616f-b4"/>
Nov 28 06:38:30 user nova-compute[74870]:     </interface>
Nov 28 06:38:30 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:30 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/console.log" append="off"/>
Nov 28 06:38:30 user nova-compute[74870]:     </serial>
Nov 28 06:38:30 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:30 user nova-compute[74870]:     <video>
Nov 28 06:38:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:30 user nova-compute[74870]:     </video>
Nov 28 06:38:30 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:30 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:30 user nova-compute[74870]:     </rng>
Nov 28 06:38:30 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:30 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:30 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:30 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:30 user nova-compute[74870]:   </devices>
Nov 28 06:38:30 user nova-compute[74870]: </domain>
Nov 28 06:38:30 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG os_vif [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb571cf-ade1-590c-bba5-f636e398fb6c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717f616f-b4, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap717f616f-b4, col_values=(('qos', UUID('de44a087-2b95-4eb7-a426-c9f3fbd7b35e')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap717f616f-b4, col_values=(('external_ids', {'iface-id': '717f616f-b485-4c7e-83be-a80086c19692', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:63:14', 'vm-uuid': '41240cc1-28a3-4685-9f80-68f5e37945b7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: INFO os_vif [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4')
Nov 28 06:38:30 user nova-compute[74870]: INFO nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Took 18.65 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No VIF found with MAC fa:16:3e:dd:63:14, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:31 user nova-compute[74870]: INFO nova.compute.manager [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Took 19.81 seconds to build instance.
Nov 28 06:38:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.215s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Successfully updated port: d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing instance network info cache due to event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Instance spawned successfully.
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: INFO nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Took 15.36 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:32 user nova-compute[74870]: INFO nova.compute.manager [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Took 16.37 seconds to build instance.
Nov 28 06:38:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.524s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance spawned successfully.
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Instance spawned successfully.
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Took 18.44 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Instance spawned successfully.
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.compute.manager [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Took 19.52 seconds to build instance.
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Took 13.63 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.872s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.compute.manager [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Took 14.83 seconds to build instance.
Nov 28 06:38:33 user nova-compute[74870]: INFO nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Took 18.78 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.945s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:34 user nova-compute[74870]: INFO nova.compute.manager [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Took 19.88 seconds to build instance.
Nov 28 06:38:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.022s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance network_info: |[{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Start _get_guest_xml network_info=[{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:35 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:35 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-692038908',display_name='tempest-ServerStableDeviceRescueTest-server-692038908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-692038908',id=7,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFaerc1nUtKDnRM+r90VFYRGdV10VQFWDLQhuqYU/TPWJ+sUFq9W+68zFlEuxEiYAsWAKxBO79ot31nQIU3RWockau4p3vhK1K7n+Hcw0HsUre+LAFsc8TGx8g99OMQA==',key_name='tempest-keypair-142163135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b30dc21619f949b18be9362b217e7c1b',ramdisk_id='',reservation_id='r-aiq041ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1091796361',owner_user_name='tempest-ServerStableDeviceRescueTest-1091796361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f53e7a2f95545d196a5b2d36ef6d692',uuid=0e5b898b-f5f0-4504-94d0-53bf8d622620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converting VIF {"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:35 user nova-compute[74870]:   <uuid>0e5b898b-f5f0-4504-94d0-53bf8d622620</uuid>
Nov 28 06:38:35 user nova-compute[74870]:   <name>instance-00000007</name>
Nov 28 06:38:35 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:35 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:35 user nova-compute[74870]:   <metadata>
Nov 28 06:38:35 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:35 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:35 user nova-compute[74870]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-692038908</nova:name>
Nov 28 06:38:35 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:35</nova:creationTime>
Nov 28 06:38:35 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:35 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:35 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:35 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:user uuid="4f53e7a2f95545d196a5b2d36ef6d692">tempest-ServerStableDeviceRescueTest-1091796361-project-member</nova:user>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:project uuid="b30dc21619f949b18be9362b217e7c1b">tempest-ServerStableDeviceRescueTest-1091796361</nova:project>
Nov 28 06:38:35 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:35 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:35 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:35 user nova-compute[74870]:         <nova:port uuid="d2a8e63d-4f39-4ef4-9d23-ad1f72acb858">
Nov 28 06:38:35 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:38:35 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:35 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:35 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:35 user nova-compute[74870]:   </metadata>
Nov 28 06:38:35 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:35 user nova-compute[74870]:     <system>
Nov 28 06:38:35 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:35 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:35 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:35 user nova-compute[74870]:       <entry name="serial">0e5b898b-f5f0-4504-94d0-53bf8d622620</entry>
Nov 28 06:38:35 user nova-compute[74870]:       <entry name="uuid">0e5b898b-f5f0-4504-94d0-53bf8d622620</entry>
Nov 28 06:38:35 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:35 user nova-compute[74870]:     </system>
Nov 28 06:38:35 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:35 user nova-compute[74870]:   <os>
Nov 28 06:38:35 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:35 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:35 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:35 user nova-compute[74870]:   </os>
Nov 28 06:38:35 user nova-compute[74870]:   <features>
Nov 28 06:38:35 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:35 user nova-compute[74870]:     <apic/>
Nov 28 06:38:35 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:35 user nova-compute[74870]:   </features>
Nov 28 06:38:35 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:35 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:35 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:35 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:35 user nova-compute[74870]:   </clock>
Nov 28 06:38:35 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:35 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:35 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:35 user nova-compute[74870]:   </cpu>
Nov 28 06:38:35 user nova-compute[74870]:   <devices>
Nov 28 06:38:35 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:35 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:35 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk"/>
Nov 28 06:38:35 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:35 user nova-compute[74870]:     </disk>
Nov 28 06:38:35 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:35 user nova-compute[74870]:       <mac address="fa:16:3e:21:69:bf"/>
Nov 28 06:38:35 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:35 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:35 user nova-compute[74870]:       <target dev="tapd2a8e63d-4f"/>
Nov 28 06:38:35 user nova-compute[74870]:     </interface>
Nov 28 06:38:35 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:35 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/console.log" append="off"/>
Nov 28 06:38:35 user nova-compute[74870]:     </serial>
Nov 28 06:38:35 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:35 user nova-compute[74870]:     <video>
Nov 28 06:38:35 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:35 user nova-compute[74870]:     </video>
Nov 28 06:38:35 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:35 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:35 user nova-compute[74870]:     </rng>
Nov 28 06:38:35 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:35 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:35 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:35 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:35 user nova-compute[74870]:   </devices>
Nov 28 06:38:35 user nova-compute[74870]: </domain>
Nov 28 06:38:35 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-692038908',display_name='tempest-ServerStableDeviceRescueTest-server-692038908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-692038908',id=7,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFaerc1nUtKDnRM+r90VFYRGdV10VQFWDLQhuqYU/TPWJ+sUFq9W+68zFlEuxEiYAsWAKxBO79ot31nQIU3RWockau4p3vhK1K7n+Hcw0HsUre+LAFsc8TGx8g99OMQA==',key_name='tempest-keypair-142163135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b30dc21619f949b18be9362b217e7c1b',ramdisk_id='',reservation_id='r-aiq041ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1091796361',owner_user_name='tempest-ServerStableDeviceRescueTest-1091796361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f53e7a2f95545d196a5b2d36ef6d692',uuid=0e5b898b-f5f0-4504-94d0-53bf8d622620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converting VIF {"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG os_vif [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70a3483b-157e-5e74-bd83-f66a1a7d9cae', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a8e63d-4f, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2a8e63d-4f, col_values=(('qos', UUID('800f0f24-2d31-4318-9708-8f5b7f441819')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2a8e63d-4f, col_values=(('external_ids', {'iface-id': 'd2a8e63d-4f39-4ef4-9d23-ad1f72acb858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:69:bf', 'vm-uuid': '0e5b898b-f5f0-4504-94d0-53bf8d622620'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:35 user nova-compute[74870]: INFO os_vif [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f')
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No VIF found with MAC fa:16:3e:21:69:bf, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance spawned successfully.
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:36 user nova-compute[74870]: INFO nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Took 15.16 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:37 user nova-compute[74870]: INFO nova.compute.manager [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Took 16.03 seconds to build instance.
Nov 28 06:38:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.323s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance spawned successfully.
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:41 user nova-compute[74870]: INFO nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Took 14.53 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:41 user nova-compute[74870]: INFO nova.compute.claims [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Claim successful on node user
Nov 28 06:38:41 user nova-compute[74870]: INFO nova.compute.manager [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Took 15.52 seconds to build instance.
Nov 28 06:38:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.622s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:42 user nova-compute[74870]: WARNING nova.compute.manager [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state active and task_state None.
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.959s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG nova.policy [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Creating image(s)
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "/opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "/opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "/opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.295s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.265s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk 1073741824" returned: 0 in 0.090s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.386s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:44 user nova-compute[74870]: WARNING nova.compute.manager [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state active and task_state None.
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] No waiting events found dispatching network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:44 user nova-compute[74870]: WARNING nova.compute.manager [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received unexpected event network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance with vm_state active and task_state None.
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.444s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Cannot resize image /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Ensure instance console log exists: /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:45 user nova-compute[74870]: WARNING nova.compute.manager [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state active and task_state None.
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Successfully created port: 519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] No waiting events found dispatching network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:46 user nova-compute[74870]: WARNING nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received unexpected event network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance with vm_state active and task_state None.
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:46 user nova-compute[74870]: WARNING nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state active and task_state None.
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:46 user nova-compute[74870]: WARNING nova.compute.manager [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state active and task_state None.
Nov 28 06:38:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Successfully updated port: 519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquired lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:48 user nova-compute[74870]: WARNING nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state active and task_state None.
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] No waiting events found dispatching network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:48 user nova-compute[74870]: WARNING nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received unexpected event network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance with vm_state active and task_state None.
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] No waiting events found dispatching network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:48 user nova-compute[74870]: WARNING nova.compute.manager [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received unexpected event network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance with vm_state active and task_state None.
Nov 28 06:38:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updating instance_info_cache with network_info: [{"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Releasing lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Instance network_info: |[{"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Start _get_guest_xml network_info=[{"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-621014352',display_name='tempest-VolumesAdminNegativeTest-server-621014352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-621014352',id=8,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMsHDWfSPBXeowpAfdbCkUBsb5GVuO2M2D2NvwxyTsWsRqGaxh5+cyygW6N+N2Y+05tishhYkLlG4xldaGcp+OIozUBSi77d0G9KooHgMQC8tV78aYf9oA5ssK3kLplYw==',key_name='tempest-keypair-1078616029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c265a98d205f4b679d3a810b4745691a',ramdisk_id='',reservation_id='r-1o21bd87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1747870246',owner_user_name='tempest-VolumesAdminNegativeTest-1747870246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e8b23eae758490a8a2476797479f208',uuid=636fad3b-617f-4a65-8cf7-ef67fd68304b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converting VIF {"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'pci_devices' on Instance uuid 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-changed-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Refreshing instance network info cache due to event network-changed-519d15c3-a87c-436b-aa7d-b6754a055382. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Acquiring lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Acquired lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Refreshing network info cache for port 519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:49 user nova-compute[74870]:   <uuid>636fad3b-617f-4a65-8cf7-ef67fd68304b</uuid>
Nov 28 06:38:49 user nova-compute[74870]:   <name>instance-00000008</name>
Nov 28 06:38:49 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:49 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:49 user nova-compute[74870]:   <metadata>
Nov 28 06:38:49 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:49 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:49 user nova-compute[74870]:       <nova:name>tempest-VolumesAdminNegativeTest-server-621014352</nova:name>
Nov 28 06:38:49 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:48</nova:creationTime>
Nov 28 06:38:49 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:49 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:49 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:49 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:user uuid="3e8b23eae758490a8a2476797479f208">tempest-VolumesAdminNegativeTest-1747870246-project-member</nova:user>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:project uuid="c265a98d205f4b679d3a810b4745691a">tempest-VolumesAdminNegativeTest-1747870246</nova:project>
Nov 28 06:38:49 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:49 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:49 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:49 user nova-compute[74870]:         <nova:port uuid="519d15c3-a87c-436b-aa7d-b6754a055382">
Nov 28 06:38:49 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 06:38:49 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:49 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:49 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:49 user nova-compute[74870]:   </metadata>
Nov 28 06:38:49 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:49 user nova-compute[74870]:     <system>
Nov 28 06:38:49 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:49 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:49 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:49 user nova-compute[74870]:       <entry name="serial">636fad3b-617f-4a65-8cf7-ef67fd68304b</entry>
Nov 28 06:38:49 user nova-compute[74870]:       <entry name="uuid">636fad3b-617f-4a65-8cf7-ef67fd68304b</entry>
Nov 28 06:38:49 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:49 user nova-compute[74870]:     </system>
Nov 28 06:38:49 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:49 user nova-compute[74870]:   <os>
Nov 28 06:38:49 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:49 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:49 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:49 user nova-compute[74870]:   </os>
Nov 28 06:38:49 user nova-compute[74870]:   <features>
Nov 28 06:38:49 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:49 user nova-compute[74870]:     <apic/>
Nov 28 06:38:49 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:49 user nova-compute[74870]:   </features>
Nov 28 06:38:49 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:49 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:49 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:49 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:49 user nova-compute[74870]:   </clock>
Nov 28 06:38:49 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:49 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:49 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:49 user nova-compute[74870]:   </cpu>
Nov 28 06:38:49 user nova-compute[74870]:   <devices>
Nov 28 06:38:49 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:49 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:49 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk"/>
Nov 28 06:38:49 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:49 user nova-compute[74870]:     </disk>
Nov 28 06:38:49 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:49 user nova-compute[74870]:       <mac address="fa:16:3e:dd:8c:b1"/>
Nov 28 06:38:49 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:49 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:49 user nova-compute[74870]:       <target dev="tap519d15c3-a8"/>
Nov 28 06:38:49 user nova-compute[74870]:     </interface>
Nov 28 06:38:49 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:49 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/console.log" append="off"/>
Nov 28 06:38:49 user nova-compute[74870]:     </serial>
Nov 28 06:38:49 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:49 user nova-compute[74870]:     <video>
Nov 28 06:38:49 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:49 user nova-compute[74870]:     </video>
Nov 28 06:38:49 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:49 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:49 user nova-compute[74870]:     </rng>
Nov 28 06:38:49 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:49 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:49 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:49 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:49 user nova-compute[74870]:   </devices>
Nov 28 06:38:49 user nova-compute[74870]: </domain>
Nov 28 06:38:49 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-621014352',display_name='tempest-VolumesAdminNegativeTest-server-621014352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-621014352',id=8,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMsHDWfSPBXeowpAfdbCkUBsb5GVuO2M2D2NvwxyTsWsRqGaxh5+cyygW6N+N2Y+05tishhYkLlG4xldaGcp+OIozUBSi77d0G9KooHgMQC8tV78aYf9oA5ssK3kLplYw==',key_name='tempest-keypair-1078616029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c265a98d205f4b679d3a810b4745691a',ramdisk_id='',reservation_id='r-1o21bd87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1747870246',owner_user_name='tempest-VolumesAdminNegativeTest-1747870246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e8b23eae758490a8a2476797479f208',uuid=636fad3b-617f-4a65-8cf7-ef67fd68304b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converting VIF {"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG os_vif [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c867082a-14ad-5569-a69d-7e671a2c7586', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap519d15c3-a8, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap519d15c3-a8, col_values=(('qos', UUID('e114038f-6072-49b0-bff9-992aaac0b884')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap519d15c3-a8, col_values=(('external_ids', {'iface-id': '519d15c3-a87c-436b-aa7d-b6754a055382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:8c:b1', 'vm-uuid': '636fad3b-617f-4a65-8cf7-ef67fd68304b'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:49 user nova-compute[74870]: INFO os_vif [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8')
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No VIF found with MAC fa:16:3e:dd:8c:b1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updated VIF entry in instance network info cache for port 519d15c3-a87c-436b-aa7d-b6754a055382. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updating instance_info_cache with network_info: [{"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Releasing lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Received event network-vif-plugged-505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Acquiring lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] No waiting events found dispatching network-vif-plugged-505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:50 user nova-compute[74870]: WARNING nova.compute.manager [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Received unexpected event network-vif-plugged-505345c6-a079-468d-be35-64932bcaef25 for instance with vm_state active and task_state None.
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Received event network-vif-plugged-505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Acquiring lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] No waiting events found dispatching network-vif-plugged-505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:50 user nova-compute[74870]: WARNING nova.compute.manager [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Received unexpected event network-vif-plugged-505345c6-a079-468d-be35-64932bcaef25 for instance with vm_state active and task_state None.
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:50 user nova-compute[74870]: INFO nova.compute.claims [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Claim successful on node user
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.892s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.policy [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7f2a6787cd478ca419181fdb7ab317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0402c76fe47cd8cd65d2ef23c46f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Creating image(s)
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "/opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "/opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "/opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.237s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.259s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk 1073741824" returned: 0 in 0.141s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.407s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.272s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Cannot resize image /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Ensure instance console log exists: /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Successfully created port: affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Successfully updated port: affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquired lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-changed-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Refreshing instance network info cache due to event network-changed-affac6e2-50a7-44d2-b7ba-ec18341bb71f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Acquiring lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updating instance_info_cache with network_info: [{"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Releasing lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Instance network_info: |[{"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Acquired lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.neutron [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Refreshing network info cache for port affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Start _get_guest_xml network_info=[{"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:54 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:54 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-517497179',display_name='tempest-TestVolumeSwap-server-517497179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-517497179',id=9,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNEi3e2JzcCpkjzBEiSZvejCbft/YLFcYrQL40RNJqMTTInfT/sTCCeFwes+Tmiq9CMXCarfk+xENzowL6bsuzmSB+K0docacw1kCH/oMTX2uXVEMErv/sdXvTkTOC5sw==',key_name='tempest-keypair-926137104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63d0402c76fe47cd8cd65d2ef23c46f8',ramdisk_id='',reservation_id='r-0wkcd3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-54352515',owner_user_name='tempest-TestVolumeSwap-54352515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7f2a6787cd478ca419181fdb7ab317',uuid=66c94c69-4907-404d-ad02-d8ba2716a4e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Converting VIF {"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lazy-loading 'pci_devices' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:54 user nova-compute[74870]:   <uuid>66c94c69-4907-404d-ad02-d8ba2716a4e7</uuid>
Nov 28 06:38:54 user nova-compute[74870]:   <name>instance-00000009</name>
Nov 28 06:38:54 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:54 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:54 user nova-compute[74870]:   <metadata>
Nov 28 06:38:54 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:54 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:54 user nova-compute[74870]:       <nova:name>tempest-TestVolumeSwap-server-517497179</nova:name>
Nov 28 06:38:54 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:54</nova:creationTime>
Nov 28 06:38:54 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:54 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:54 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:54 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:user uuid="ec7f2a6787cd478ca419181fdb7ab317">tempest-TestVolumeSwap-54352515-project-member</nova:user>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:project uuid="63d0402c76fe47cd8cd65d2ef23c46f8">tempest-TestVolumeSwap-54352515</nova:project>
Nov 28 06:38:54 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:54 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:54 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:54 user nova-compute[74870]:         <nova:port uuid="affac6e2-50a7-44d2-b7ba-ec18341bb71f">
Nov 28 06:38:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:38:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:54 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:54 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:54 user nova-compute[74870]:   </metadata>
Nov 28 06:38:54 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:54 user nova-compute[74870]:     <system>
Nov 28 06:38:54 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:54 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:54 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:54 user nova-compute[74870]:       <entry name="serial">66c94c69-4907-404d-ad02-d8ba2716a4e7</entry>
Nov 28 06:38:54 user nova-compute[74870]:       <entry name="uuid">66c94c69-4907-404d-ad02-d8ba2716a4e7</entry>
Nov 28 06:38:54 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:54 user nova-compute[74870]:     </system>
Nov 28 06:38:54 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:54 user nova-compute[74870]:   <os>
Nov 28 06:38:54 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:54 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:54 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:54 user nova-compute[74870]:   </os>
Nov 28 06:38:54 user nova-compute[74870]:   <features>
Nov 28 06:38:54 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:54 user nova-compute[74870]:     <apic/>
Nov 28 06:38:54 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:54 user nova-compute[74870]:   </features>
Nov 28 06:38:54 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:54 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:54 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:54 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:54 user nova-compute[74870]:   </clock>
Nov 28 06:38:54 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:54 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:54 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:54 user nova-compute[74870]:   </cpu>
Nov 28 06:38:54 user nova-compute[74870]:   <devices>
Nov 28 06:38:54 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:54 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:54 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk"/>
Nov 28 06:38:54 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:54 user nova-compute[74870]:     </disk>
Nov 28 06:38:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:54 user nova-compute[74870]:       <mac address="fa:16:3e:65:c4:d1"/>
Nov 28 06:38:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:54 user nova-compute[74870]:       <target dev="tapaffac6e2-50"/>
Nov 28 06:38:54 user nova-compute[74870]:     </interface>
Nov 28 06:38:54 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:54 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/console.log" append="off"/>
Nov 28 06:38:54 user nova-compute[74870]:     </serial>
Nov 28 06:38:54 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:54 user nova-compute[74870]:     <video>
Nov 28 06:38:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:54 user nova-compute[74870]:     </video>
Nov 28 06:38:54 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:54 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:54 user nova-compute[74870]:     </rng>
Nov 28 06:38:54 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:54 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:54 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:54 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:54 user nova-compute[74870]:   </devices>
Nov 28 06:38:54 user nova-compute[74870]: </domain>
Nov 28 06:38:54 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-517497179',display_name='tempest-TestVolumeSwap-server-517497179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-517497179',id=9,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNEi3e2JzcCpkjzBEiSZvejCbft/YLFcYrQL40RNJqMTTInfT/sTCCeFwes+Tmiq9CMXCarfk+xENzowL6bsuzmSB+K0docacw1kCH/oMTX2uXVEMErv/sdXvTkTOC5sw==',key_name='tempest-keypair-926137104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63d0402c76fe47cd8cd65d2ef23c46f8',ramdisk_id='',reservation_id='r-0wkcd3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-54352515',owner_user_name='tempest-TestVolumeSwap-54352515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7f2a6787cd478ca419181fdb7ab317',uuid=66c94c69-4907-404d-ad02-d8ba2716a4e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Converting VIF {"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG os_vif [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60cb6308-c641-5fe0-a893-7c1871218e09', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaffac6e2-50, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaffac6e2-50, col_values=(('qos', UUID('5b0fd575-3a23-47f6-8c69-ff93d175a871')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaffac6e2-50, col_values=(('external_ids', {'iface-id': 'affac6e2-50a7-44d2-b7ba-ec18341bb71f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:c4:d1', 'vm-uuid': '66c94c69-4907-404d-ad02-d8ba2716a4e7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: INFO os_vif [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50')
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Instance spawned successfully.
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] No VIF found with MAC fa:16:3e:65:c4:d1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:54 user nova-compute[74870]: INFO nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Took 11.79 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:54 user nova-compute[74870]: INFO nova.compute.manager [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Took 13.45 seconds to build instance.
Nov 28 06:38:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.614s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.network.neutron [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updated VIF entry in instance network info cache for port affac6e2-50a7-44d2-b7ba-ec18341bb71f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.network.neutron [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updating instance_info_cache with network_info: [{"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Releasing lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:38:55 user nova-compute[74870]: INFO nova.compute.claims [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Claim successful on node user
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:38:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:38:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG nova.policy [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f854afd1c504c7ba7eea6643d7bc7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8c916eb72b4f5cb1b3fa97845e2072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:38:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Creating image(s)
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "/opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "/opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk 1073741824" returned: 0 in 0.068s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Successfully created port: 44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.259s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:38:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Cannot resize image /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Ensure instance console log exists: /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Successfully updated port: 44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquired lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-changed-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Refreshing instance network info cache due to event network-changed-44cb2e46-5eae-4728-ac61-29177ecb06f6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Acquiring lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updating instance_info_cache with network_info: [{"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Releasing lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Instance network_info: |[{"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Acquired lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.neutron [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Refreshing network info cache for port 44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Start _get_guest_xml network_info=[{"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:38:57 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:57 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2057452123',display_name='tempest-VolumesAssistedSnapshotsTest-server-2057452123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2057452123',id=10,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlsgIHBkjqeXLgCZOFjOk2R3rFX+Exf4pm9jd/j6HnEa74ku0fNjIAuyGrYRiG220+GjsvdmFmAGshilmUdIU2Uzk7IAbyaHHmjO0U8FLqIFGGoaUXURCrhv/WaOkKAsw==',key_name='tempest-keypair-1012101206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f8c916eb72b4f5cb1b3fa97845e2072',ramdisk_id='',reservation_id='r-hti819ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-736418019',owner_user_name='tempest-VolumesAssistedSnapshotsTest-736418019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f854afd1c504c7ba7eea6643d7bc7c9',uuid=e3406c2b-4e6e-4be0-b84a-168c59322f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Converting VIF {"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lazy-loading 'pci_devices' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:38:57 user nova-compute[74870]:   <uuid>e3406c2b-4e6e-4be0-b84a-168c59322f00</uuid>
Nov 28 06:38:57 user nova-compute[74870]:   <name>instance-0000000a</name>
Nov 28 06:38:57 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:38:57 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:38:57 user nova-compute[74870]:   <metadata>
Nov 28 06:38:57 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:38:57 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:38:57 user nova-compute[74870]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2057452123</nova:name>
Nov 28 06:38:57 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:38:57</nova:creationTime>
Nov 28 06:38:57 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:38:57 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:38:57 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:38:57 user nova-compute[74870]:       <nova:owner>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:user uuid="0f854afd1c504c7ba7eea6643d7bc7c9">tempest-VolumesAssistedSnapshotsTest-736418019-project-member</nova:user>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:project uuid="7f8c916eb72b4f5cb1b3fa97845e2072">tempest-VolumesAssistedSnapshotsTest-736418019</nova:project>
Nov 28 06:38:57 user nova-compute[74870]:       </nova:owner>
Nov 28 06:38:57 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:38:57 user nova-compute[74870]:       <nova:ports>
Nov 28 06:38:57 user nova-compute[74870]:         <nova:port uuid="44cb2e46-5eae-4728-ac61-29177ecb06f6">
Nov 28 06:38:57 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 06:38:57 user nova-compute[74870]:         </nova:port>
Nov 28 06:38:57 user nova-compute[74870]:       </nova:ports>
Nov 28 06:38:57 user nova-compute[74870]:     </nova:instance>
Nov 28 06:38:57 user nova-compute[74870]:   </metadata>
Nov 28 06:38:57 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:38:57 user nova-compute[74870]:     <system>
Nov 28 06:38:57 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:38:57 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:38:57 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:38:57 user nova-compute[74870]:       <entry name="serial">e3406c2b-4e6e-4be0-b84a-168c59322f00</entry>
Nov 28 06:38:57 user nova-compute[74870]:       <entry name="uuid">e3406c2b-4e6e-4be0-b84a-168c59322f00</entry>
Nov 28 06:38:57 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:38:57 user nova-compute[74870]:     </system>
Nov 28 06:38:57 user nova-compute[74870]:   </sysinfo>
Nov 28 06:38:57 user nova-compute[74870]:   <os>
Nov 28 06:38:57 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:38:57 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:38:57 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:38:57 user nova-compute[74870]:   </os>
Nov 28 06:38:57 user nova-compute[74870]:   <features>
Nov 28 06:38:57 user nova-compute[74870]:     <acpi/>
Nov 28 06:38:57 user nova-compute[74870]:     <apic/>
Nov 28 06:38:57 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:38:57 user nova-compute[74870]:   </features>
Nov 28 06:38:57 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:38:57 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:38:57 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:38:57 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:38:57 user nova-compute[74870]:   </clock>
Nov 28 06:38:57 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:38:57 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:38:57 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:38:57 user nova-compute[74870]:   </cpu>
Nov 28 06:38:57 user nova-compute[74870]:   <devices>
Nov 28 06:38:57 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:38:57 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:38:57 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk"/>
Nov 28 06:38:57 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:38:57 user nova-compute[74870]:     </disk>
Nov 28 06:38:57 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:38:57 user nova-compute[74870]:       <mac address="fa:16:3e:e9:e0:dc"/>
Nov 28 06:38:57 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:57 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:38:57 user nova-compute[74870]:       <target dev="tap44cb2e46-5e"/>
Nov 28 06:38:57 user nova-compute[74870]:     </interface>
Nov 28 06:38:57 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:38:57 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/console.log" append="off"/>
Nov 28 06:38:57 user nova-compute[74870]:     </serial>
Nov 28 06:38:57 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:38:57 user nova-compute[74870]:     <video>
Nov 28 06:38:57 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:38:57 user nova-compute[74870]:     </video>
Nov 28 06:38:57 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:38:57 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:38:57 user nova-compute[74870]:     </rng>
Nov 28 06:38:57 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:38:57 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:38:57 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:38:57 user nova-compute[74870]:     </memballoon>
Nov 28 06:38:57 user nova-compute[74870]:   </devices>
Nov 28 06:38:57 user nova-compute[74870]: </domain>
Nov 28 06:38:57 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2057452123',display_name='tempest-VolumesAssistedSnapshotsTest-server-2057452123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2057452123',id=10,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlsgIHBkjqeXLgCZOFjOk2R3rFX+Exf4pm9jd/j6HnEa74ku0fNjIAuyGrYRiG220+GjsvdmFmAGshilmUdIU2Uzk7IAbyaHHmjO0U8FLqIFGGoaUXURCrhv/WaOkKAsw==',key_name='tempest-keypair-1012101206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f8c916eb72b4f5cb1b3fa97845e2072',ramdisk_id='',reservation_id='r-hti819ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-736418019',owner_user_name='tempest-VolumesAssistedSnapshotsTest-736418019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f854afd1c504c7ba7eea6643d7bc7c9',uuid=e3406c2b-4e6e-4be0-b84a-168c59322f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Converting VIF {"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG os_vif [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '715af9a3-f6ae-5f25-94c8-836e8d4375c7', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44cb2e46-5e, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44cb2e46-5e, col_values=(('qos', UUID('7fb8f810-353a-4788-b7d3-f8ea4ea7e89f')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44cb2e46-5e, col_values=(('external_ids', {'iface-id': '44cb2e46-5eae-4728-ac61-29177ecb06f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:e0:dc', 'vm-uuid': 'e3406c2b-4e6e-4be0-b84a-168c59322f00'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:38:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:57 user nova-compute[74870]: INFO os_vif [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e')
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] No VIF found with MAC fa:16:3e:e9:e0:dc, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.network.neutron [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updated VIF entry in instance network info cache for port 44cb2e46-5eae-4728-ac61-29177ecb06f6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.network.neutron [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updating instance_info_cache with network_info: [{"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Releasing lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:38:58 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Instance spawned successfully.
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:38:58 user nova-compute[74870]: INFO nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Took 7.41 seconds to spawn the instance on the hypervisor.
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:38:58 user nova-compute[74870]: INFO nova.compute.manager [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Took 8.88 seconds to build instance.
Nov 28 06:38:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.035s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:38:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] No waiting events found dispatching network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:38:58 user nova-compute[74870]: WARNING nova.compute.manager [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received unexpected event network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance with vm_state active and task_state None.
Nov 28 06:38:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:38:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:00 user nova-compute[74870]: WARNING nova.compute.manager [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state active and task_state None.
Nov 28 06:39:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] No waiting events found dispatching network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:01 user nova-compute[74870]: WARNING nova.compute.manager [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received unexpected event network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance with vm_state active and task_state None.
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:39:01 user nova-compute[74870]: INFO nova.compute.claims [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Claim successful on node user
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:39:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Instance spawned successfully.
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:02 user nova-compute[74870]: WARNING nova.compute.manager [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state active and task_state None.
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:39:02 user nova-compute[74870]: INFO nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:39:02 user nova-compute[74870]: INFO nova.compute.manager [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Took 7.78 seconds to build instance.
Nov 28 06:39:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:39:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.929s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:39:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:03 user nova-compute[74870]: DEBUG nova.policy [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:39:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:03 user nova-compute[74870]: INFO nova.virt.block_device [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Booting with volume 1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 at /dev/vda
Nov 28 06:39:03 user nova-compute[74870]: DEBUG os_brick.utils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:03 user nova-compute[74870]: INFO oslo.privsep.daemon [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpg_foyuft/privsep.sock']
Nov 28 06:39:03 user sudo[85882]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpg_foyuft/privsep.sock
Nov 28 06:39:03 user sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 06:39:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 06:39:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 06:39:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 06:39:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Successfully created port: e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Successfully updated port: e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquired lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-changed-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Refreshing instance network info cache due to event network-changed-e8244d47-16b3-4035-8877-b5d7b137dea6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Acquiring lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:39:05 user sudo[85882]: pam_unix(sudo:session): session closed for user root
Nov 28 06:39:05 user nova-compute[74870]: INFO oslo.privsep.daemon [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Spawned new privsep daemon via rootwrap
Nov 28 06:39:05 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 06:39:05 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 06:39:05 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 06:39:05 user nova-compute[74870]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85885
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22b250-c41a-41de-afac-91a8e85149fd]: (2,) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updating instance_info_cache with network_info: [{"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Releasing lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance network_info: |[{"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df9757d-f9c4-493e-b653-5cc325e2175d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Acquired lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.network.neutron [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Refreshing network info cache for port e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:05 user nova-compute[74870]: WARNING os_brick.initiator.connectors.nvmeof [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdba9fb-d7c8-4e33-88c2-ae908c301ecf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e646c68c-acc3-48c1-a84b-d8b455229bf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5948eb9c-aa09-4f17-b096-6eae717e7f9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:05 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:39:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c76f9a-ea62-48b2-b62a-9a585cb85d50]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG os_brick.utils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== get_connector_properties: return (2183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:05 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updating existing volume attachment record: 21de1576-d229-4e6c-b28f-b8899bf8ad8b {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updated VIF entry in instance network info cache for port e8244d47-16b3-4035-8877-b5d7b137dea6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updating instance_info_cache with network_info: [{"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Releasing lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] No waiting events found dispatching network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:06 user nova-compute[74870]: WARNING nova.compute.manager [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received unexpected event network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 for instance with vm_state active and task_state None.
Nov 28 06:39:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] No waiting events found dispatching network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:08 user nova-compute[74870]: WARNING nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received unexpected event network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 for instance with vm_state active and task_state None.
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] No waiting events found dispatching network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:08 user nova-compute[74870]: WARNING nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received unexpected event network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance with vm_state active and task_state None.
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] No waiting events found dispatching network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:08 user nova-compute[74870]: WARNING nova.compute.manager [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received unexpected event network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance with vm_state active and task_state None.
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Skipping network cache update for instance because it is Building. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:39:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:14 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:39:14 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7173MB free_disk=25.799057006835938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:39:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Creating image(s)
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Ensure instance console log exists: /opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Start _get_guest_xml network_info=[{"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70280af1-c742-4096-9abc-7a1ca9b44079', 'attached_at': '', 'detached_at': '', 'volume_id': '1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'serial': '1d9c5b72-fcf3-422e-bee9-f2fffafb9d92'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '21de1576-d229-4e6c-b28f-b8899bf8ad8b', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:39:14 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:39:14 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connector [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Factory for ISCSI on None {{(pid=74870) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:14 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:14 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:14 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance b4802806-6422-46da-8d0f-5674af0a8433 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e3406c2b-4e6e-4be0-b84a-168c59322f00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 70280af1-c742-4096-9abc-7a1ca9b44079 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[689070fb-8f2d-43f1-8d33-d550f1ef2eca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:39:14 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:14 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9213bcf1-9fec-4dbb-accd-ce42cdd225de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92] added
Nov 28 06:39:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4a78db-b2e5-488b-939a-c6c5c1da5b80]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a894cc-7823-4e7d-8397-088a5b80f2c3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBFAvuXT {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBFAvuXT" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee0e996-c688-4484-bf74-856de1179b2d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBFAvuXT'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da922ed7-50c2-47cd-9f32-93ff0cbf3225]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94bd9a9-66a2-46af-ba70-1ec84c57e012]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 06:39:15 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 06:39:15 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:15 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 06:39:15 user nova-compute[74870]: 
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2017a0a4-d8ec-4565-a45d-df2a9f29811f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]
Nov 28 06:39:15 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.
Nov 28 06:39:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170c8e2-6da7-4612-9d53-cb62c50dcbf9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e857ac5f-622f-4056-a104-dacdfd6dc940]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db05f30f-6369-4586-81fb-cb36d065edb9]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:39:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.964s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23934653139386434', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653139386434', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1245407202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1245407202',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg==',key_name='tempest-keypair-885228878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff4ac048770a4680a35f71465d191d49',ramdisk_id='',reservation_id='r-l9wr9xfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-960022347',owner_user_name='tempest-ServerActionsV293TestJSON-960022347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48e7c51916684bec98970a963f2c560e',uuid=70280af1-c742-4096-9abc-7a1ca9b44079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converting VIF {"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.objects.instance [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lazy-loading 'pci_devices' on Instance uuid 70280af1-c742-4096-9abc-7a1ca9b44079 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:39:16 user nova-compute[74870]:   <uuid>70280af1-c742-4096-9abc-7a1ca9b44079</uuid>
Nov 28 06:39:16 user nova-compute[74870]:   <name>instance-0000000b</name>
Nov 28 06:39:16 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:39:16 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:39:16 user nova-compute[74870]:   <metadata>
Nov 28 06:39:16 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:39:16 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:39:16 user nova-compute[74870]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1245407202</nova:name>
Nov 28 06:39:16 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:39:14</nova:creationTime>
Nov 28 06:39:16 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:39:16 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:39:16 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:39:16 user nova-compute[74870]:       <nova:owner>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:user uuid="48e7c51916684bec98970a963f2c560e">tempest-ServerActionsV293TestJSON-960022347-project-member</nova:user>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:project uuid="ff4ac048770a4680a35f71465d191d49">tempest-ServerActionsV293TestJSON-960022347</nova:project>
Nov 28 06:39:16 user nova-compute[74870]:       </nova:owner>
Nov 28 06:39:16 user nova-compute[74870]:       <nova:ports>
Nov 28 06:39:16 user nova-compute[74870]:         <nova:port uuid="e8244d47-16b3-4035-8877-b5d7b137dea6">
Nov 28 06:39:16 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 06:39:16 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:16 user nova-compute[74870]:       </nova:ports>
Nov 28 06:39:16 user nova-compute[74870]:     </nova:instance>
Nov 28 06:39:16 user nova-compute[74870]:   </metadata>
Nov 28 06:39:16 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:39:16 user nova-compute[74870]:     <system>
Nov 28 06:39:16 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:39:16 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:39:16 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:39:16 user nova-compute[74870]:       <entry name="serial">70280af1-c742-4096-9abc-7a1ca9b44079</entry>
Nov 28 06:39:16 user nova-compute[74870]:       <entry name="uuid">70280af1-c742-4096-9abc-7a1ca9b44079</entry>
Nov 28 06:39:16 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:39:16 user nova-compute[74870]:     </system>
Nov 28 06:39:16 user nova-compute[74870]:   </sysinfo>
Nov 28 06:39:16 user nova-compute[74870]:   <os>
Nov 28 06:39:16 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:39:16 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:39:16 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:39:16 user nova-compute[74870]:   </os>
Nov 28 06:39:16 user nova-compute[74870]:   <features>
Nov 28 06:39:16 user nova-compute[74870]:     <acpi/>
Nov 28 06:39:16 user nova-compute[74870]:     <apic/>
Nov 28 06:39:16 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:39:16 user nova-compute[74870]:   </features>
Nov 28 06:39:16 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:39:16 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:39:16 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:39:16 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:39:16 user nova-compute[74870]:   </clock>
Nov 28 06:39:16 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:39:16 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:39:16 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:39:16 user nova-compute[74870]:   </cpu>
Nov 28 06:39:16 user nova-compute[74870]:   <devices>
Nov 28 06:39:16 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:39:16 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:39:16 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 06:39:16 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:39:16 user nova-compute[74870]:       <serial>1d9c5b72-fcf3-422e-bee9-f2fffafb9d92</serial>
Nov 28 06:39:16 user nova-compute[74870]:     </disk>
Nov 28 06:39:16 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:16 user nova-compute[74870]:       <mac address="fa:16:3e:4b:80:9f"/>
Nov 28 06:39:16 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:16 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:16 user nova-compute[74870]:       <target dev="tape8244d47-16"/>
Nov 28 06:39:16 user nova-compute[74870]:     </interface>
Nov 28 06:39:16 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:39:16 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079/console.log" append="off"/>
Nov 28 06:39:16 user nova-compute[74870]:     </serial>
Nov 28 06:39:16 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:39:16 user nova-compute[74870]:     <video>
Nov 28 06:39:16 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:16 user nova-compute[74870]:     </video>
Nov 28 06:39:16 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:39:16 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:39:16 user nova-compute[74870]:     </rng>
Nov 28 06:39:16 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:39:16 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:39:16 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:39:16 user nova-compute[74870]:     </memballoon>
Nov 28 06:39:16 user nova-compute[74870]:   </devices>
Nov 28 06:39:16 user nova-compute[74870]: </domain>
Nov 28 06:39:16 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1245407202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1245407202',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg==',key_name='tempest-keypair-885228878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff4ac048770a4680a35f71465d191d49',ramdisk_id='',reservation_id='r-l9wr9xfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-960022347',owner_user_name='tempest-ServerActionsV293TestJSON-960022347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48e7c51916684bec98970a963f2c560e',uuid=70280af1-c742-4096-9abc-7a1ca9b44079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converting VIF {"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG os_vif [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '594ba5be-afcf-598f-b8bc-1ab310572892', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8244d47-16, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8244d47-16, col_values=(('qos', UUID('c7b6a7ab-cbfa-4d4b-b88d-9bf439859453')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8244d47-16, col_values=(('external_ids', {'iface-id': 'e8244d47-16b3-4035-8877-b5d7b137dea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:80:9f', 'vm-uuid': '70280af1-c742-4096-9abc-7a1ca9b44079'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:16 user nova-compute[74870]: INFO os_vif [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16')
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:39:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] No VIF found with MAC fa:16:3e:4b:80:9f, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:39:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:18 user nova-compute[74870]: WARNING nova.compute.manager [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state building and task_state spawning.
Nov 28 06:39:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:39:19 user nova-compute[74870]: INFO nova.compute.claims [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Claim successful on node user
Nov 28 06:39:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance spawned successfully.
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:39:20 user nova-compute[74870]: INFO nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:39:20 user nova-compute[74870]: INFO nova.compute.manager [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Took 18.39 seconds to build instance.
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:20 user nova-compute[74870]: WARNING nova.compute.manager [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state active and task_state None.
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.525s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:39:20 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:39:20 user nova-compute[74870]: INFO nova.virt.block_device [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Booting with volume 747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c at /dev/vda
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.policy [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG os_brick.utils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf816afd-a953-4909-94c1-24630cec7a07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f346b8-6fe1-43e6-b175-849640ad346f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e22f30-c128-49f7-9365-1ff498944b40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6341174-13c2-4c57-9834-4374ff20080f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:20 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:39:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7905b0f1-d375-4d2e-8f61-e8f756907df8]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG os_brick.utils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:20 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating existing volume attachment record: cb0afd6c-29f8-4749-80a6-7e0795cf2486 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:39:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully created port: 1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:39:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully created port: a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:39:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully created port: 97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:39:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully created port: 7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:39:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully created port: 6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: 1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-1c17febf-a6ee-4954-9d0c-f6282ae774ea. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port 1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:39:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-b1021f35-3b88-4288-818c-325753086daf. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG nova.network.neutron [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: 97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: 7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:28 user nova-compute[74870]: INFO nova.virt.block_device [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Booting with volume 3d001b09-312c-44d4-a06d-03d7e311f349 at /dev/vdb
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Successfully updated port: 6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG os_brick.utils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a76b31-6f96-42d4-b275-f7cf6124fdd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-a7a63db6-53d0-4e2f-acad-d649701a3f90. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf9411-eb50-43f3-996e-bc793d43b86b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88cb9a-02a7-47e9-9f35-81a6e5ec10e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[711a2182-ea30-42ef-9180-9e60eff0e778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:28 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:39:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54724489-b0bc-479f-b04c-7fd12ef6da71]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG os_brick.utils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:28 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating existing volume attachment record: 0308b57c-a3d6-4048-916a-bad722341e40 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:39:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-6192ac90-a8ff-46d9-914f-ab6894136423. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance network_info: |[{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updated VIF entry in instance network info cache for port a7a63db6-53d0-4e2f-acad-d649701a3f90. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-97c7e28d-01ae-4b01-8594-2e507f37eeb7. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:31 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port 97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updated VIF entry in instance network info cache for port 97c7e28d-01ae-4b01-8594-2e507f37eeb7. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port 7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updated VIF entry in instance network info cache for port 7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:39:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port 6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:39:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updated VIF entry in instance network info cache for port 6192ac90-a8ff-46d9-914f-ab6894136423. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:39:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:39:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:39:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:37 user nova-compute[74870]: INFO nova.virt.block_device [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Booting with volume cfaded18-7989-4c10-bd0b-ab1878aed584 at /dev/vdc
Nov 28 06:39:37 user nova-compute[74870]: DEBUG os_brick.utils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1319d3e-746a-4ce1-abbe-bbd0435dbef2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6657b-01de-4f53-a702-b69dacfeb49b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea1708-ccee-46b2-a5b8-215103ebf2a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d5a14-9bf2-430c-9ba9-9532d2dae5eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:39:37 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:39:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029c338-7e7f-4cf3-9164-b06d3a358478]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG os_brick.utils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:37 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating existing volume attachment record: b5712ec7-0c0f-42db-a801-cbc21b7aa37c {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:39:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:39:50 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Creating image(s)
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Ensure instance console log exists: /opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Start _get_guest_xml network_info=[{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpjCbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04d6da52-74d4-4a87-b8b8-f5349354d8ee', 'attached_at': '', 'detached_at': '', 'volume_id': '747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c', 'serial': '747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'cb0afd6c-29f8-4749-80a6-7e0795cf2486', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqnLwyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04d6da52-74d4-4a87-b8b8-f5349354d8ee', 'attached_at': '', 'detached_at': '', 'volume_id': '3d001b09-312c-44d4-a06d-03d7e311f349', 'serial': '3d001b09-312c-44d4-a06d-03d7e311f349'}, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '0308b57c-a3d6-4048-916a-bad722341e40', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suoqTAfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04d6da52-74d4-4a87-b8b8-f5349354d8ee', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfaded18-7989-4c10-bd0b-ab1878aed584', 'serial': 'cfaded18-7989-4c10-bd0b-ab1878aed584'}, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'b5712ec7-0c0f-42db-a801-cbc21b7aa37c', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:39:50 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:39:50 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpjCbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:50 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:50 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:50 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe42d1-dbe5-4b0e-b4f9-52f10ca02e0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:39:50 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53575609-f632-4b0f-a533-275a0789adb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c] added
Nov 28 06:39:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b2bb5-6782-4606-b334-8845b8e6a048]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b5d56-f41d-4a4b-9684-2eece7292727]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmpjCbMy {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmpjCbMy" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[69281195-b750-400e-a113-8f572704629d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JmpjCbMy'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2644d2-fd63-47b3-aff1-aaa63ee42b5c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e017456e-3dfc-469b-8510-705e7f93cba0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3f56ed-99b9-4015-8514-1a3c15ca4dbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260]
Nov 28 06:39:50 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260] successful.
Nov 28 06:39:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2c524-f1fc-4657-a441-69c8c26a6ba8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e071b12-b4b1-4008-9b4c-d8b5e00810d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:50 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:50 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1671c-2fa4-4a37-b9aa-c003240551de]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:39:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpjCbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23363366463326661', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363366463326661', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqnLwyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:51 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:51 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:51 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[207ea11d-06b5-4e90-b1d5-9d592aae09ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:39:51 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3ef6ed-195d-4681-a0dc-fbea0e5e1e57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349] added
Nov 28 06:39:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be67d8f-557b-41f3-90a5-397e8d02cab8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd34c8-f5ff-48c8-8280-c663d59da46f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqnLwyxS {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqnLwyxS" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71f0c2a-9ee5-411f-992b-72a845aca269]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqnLwyxS'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd78eb8d-268c-4845-a5ff-3267c916593b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cd6fc3-9006-4d9e-a9c9-5ed764ffb816]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:51 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:51 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45aedec-30f6-46de-8a01-ba093a5a82b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260]
Nov 28 06:39:51 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260] successful.
Nov 28 06:39:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f5a48-d8b3-4acf-83ac-a0f26e6d9b75]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca469e27-d826-4d6f-9ed7-22dcb7f64bf8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:52 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:52 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:39:52 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:52 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:52 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:39:52 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ae6465-1f43-41b3-8046-e8c7b60bd5c1]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:39:52 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqnLwyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26362613632623239', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362613632623239', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suoqTAfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:39:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:39:53 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac67ba62-5858-4c24-b458-270fbff80e48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:39:53 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2dee2-0070-4a33-87f6-c286bee4ae46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584] added
Nov 28 06:39:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d1e36c-c71d-4ee7-9238-a339b26080fd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1790ef03-3e84-40bf-9c2a-bd65c8dd2841]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suoqTAfx {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suoqTAfx" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb037ec2-1e03-4781-be46-0a8bd88e3a51]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'suoqTAfx'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce60a4-0ded-4c67-a05b-640ba0cce46b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[635af8a1-019c-4c47-b3a9-6d2b6792ec62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960c2a3-0cba-4610-9af9-81240c59dd5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260]
Nov 28 06:39:53 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260] successful.
Nov 28 06:39:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e280b-cdc5-4a7b-8767-ea55f793499f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60bd626-9498-416c-b226-6117b0b8d36a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:39:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8234d3ca-94b0-4226-83ad-1ebadb5d57e9]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suoqTAfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:39:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23730306562646665', 'path': '/dev/sde'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730306562646665', 'path': '/dev/sde'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lazy-loading 'pci_devices' on Instance uuid 04d6da52-74d4-4a87-b8b8-f5349354d8ee {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:39:54 user nova-compute[74870]:   <uuid>04d6da52-74d4-4a87-b8b8-f5349354d8ee</uuid>
Nov 28 06:39:54 user nova-compute[74870]:   <name>instance-0000000c</name>
Nov 28 06:39:54 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:39:54 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:39:54 user nova-compute[74870]:   <metadata>
Nov 28 06:39:54 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:39:54 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:39:54 user nova-compute[74870]:       <nova:name>tempest-device-tagging-server-1923245599</nova:name>
Nov 28 06:39:54 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:39:50</nova:creationTime>
Nov 28 06:39:54 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:39:54 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:39:54 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:39:54 user nova-compute[74870]:       <nova:owner>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:user uuid="58a9aacbcb174f658f3cbba2e84d6e5b">tempest-TaggedBootDevicesTest-809434738-project-member</nova:user>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:project uuid="49de64e4ec95433297cb192cadd60402">tempest-TaggedBootDevicesTest-809434738</nova:project>
Nov 28 06:39:54 user nova-compute[74870]:       </nova:owner>
Nov 28 06:39:54 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:39:54 user nova-compute[74870]:       <nova:ports>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="1c17febf-a6ee-4954-9d0c-f6282ae774ea">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="b1021f35-3b88-4288-818c-325753086daf">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="cf5914b8-0656-47c2-ba2c-2fe6d04a6a65">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="a7a63db6-53d0-4e2f-acad-d649701a3f90">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="97c7e28d-01ae-4b01-8594-2e507f37eeb7">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:         <nova:port uuid="6192ac90-a8ff-46d9-914f-ab6894136423">
Nov 28 06:39:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 06:39:54 user nova-compute[74870]:         </nova:port>
Nov 28 06:39:54 user nova-compute[74870]:       </nova:ports>
Nov 28 06:39:54 user nova-compute[74870]:     </nova:instance>
Nov 28 06:39:54 user nova-compute[74870]:   </metadata>
Nov 28 06:39:54 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:39:54 user nova-compute[74870]:     <system>
Nov 28 06:39:54 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:39:54 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:39:54 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:39:54 user nova-compute[74870]:       <entry name="serial">04d6da52-74d4-4a87-b8b8-f5349354d8ee</entry>
Nov 28 06:39:54 user nova-compute[74870]:       <entry name="uuid">04d6da52-74d4-4a87-b8b8-f5349354d8ee</entry>
Nov 28 06:39:54 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:39:54 user nova-compute[74870]:     </system>
Nov 28 06:39:54 user nova-compute[74870]:   </sysinfo>
Nov 28 06:39:54 user nova-compute[74870]:   <os>
Nov 28 06:39:54 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:39:54 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:39:54 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:39:54 user nova-compute[74870]:   </os>
Nov 28 06:39:54 user nova-compute[74870]:   <features>
Nov 28 06:39:54 user nova-compute[74870]:     <acpi/>
Nov 28 06:39:54 user nova-compute[74870]:     <apic/>
Nov 28 06:39:54 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:39:54 user nova-compute[74870]:   </features>
Nov 28 06:39:54 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:39:54 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:39:54 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:39:54 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:39:54 user nova-compute[74870]:   </clock>
Nov 28 06:39:54 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:39:54 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:39:54 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:39:54 user nova-compute[74870]:   </cpu>
Nov 28 06:39:54 user nova-compute[74870]:   <devices>
Nov 28 06:39:54 user nova-compute[74870]:     <disk type="file" device="cdrom">
Nov 28 06:39:54 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 06:39:54 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee/disk.config"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="hda" bus="ide"/>
Nov 28 06:39:54 user nova-compute[74870]:     </disk>
Nov 28 06:39:54 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:39:54 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:39:54 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <serial>747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c</serial>
Nov 28 06:39:54 user nova-compute[74870]:     </disk>
Nov 28 06:39:54 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:39:54 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:39:54 user nova-compute[74870]:       <source dev="/dev/sdd"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <serial>3d001b09-312c-44d4-a06d-03d7e311f349</serial>
Nov 28 06:39:54 user nova-compute[74870]:     </disk>
Nov 28 06:39:54 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:39:54 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:39:54 user nova-compute[74870]:       <source dev="/dev/sde"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="vdc" bus="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <serial>cfaded18-7989-4c10-bd0b-ab1878aed584</serial>
Nov 28 06:39:54 user nova-compute[74870]:     </disk>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:52:47:ee"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tap1c17febf-a6"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:08:b5:4a"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tapb1021f35-3b"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:e9:b0:8c"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tapcf5914b8-06"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:71:e9:1e"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tapa7a63db6-53"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:e9:f3:24"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tap97c7e28d-01"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:c3:3a:b8"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tap7e4ed8f6-1a"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:39:54 user nova-compute[74870]:       <mac address="fa:16:3e:2f:a9:cc"/>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:39:54 user nova-compute[74870]:       <target dev="tap6192ac90-a8"/>
Nov 28 06:39:54 user nova-compute[74870]:     </interface>
Nov 28 06:39:54 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:39:54 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee/console.log" append="off"/>
Nov 28 06:39:54 user nova-compute[74870]:     </serial>
Nov 28 06:39:54 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:39:54 user nova-compute[74870]:     <video>
Nov 28 06:39:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:39:54 user nova-compute[74870]:     </video>
Nov 28 06:39:54 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:39:54 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:39:54 user nova-compute[74870]:     </rng>
Nov 28 06:39:54 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:39:54 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:39:54 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:39:54 user nova-compute[74870]:     </memballoon>
Nov 28 06:39:54 user nova-compute[74870]:   </devices>
Nov 28 06:39:54 user nova-compute[74870]: </domain>
Nov 28 06:39:54 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e52fc12-3569-5faf-b53f-49b140374cba', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c17febf-a6, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c17febf-a6, col_values=(('qos', UUID('77f7d25e-9068-4186-91d0-1c715717ee6c')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c17febf-a6, col_values=(('external_ids', {'iface-id': '1c17febf-a6ee-4954-9d0c-f6282ae774ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:47:ee', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6')
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fad92d43-095d-5583-91c6-530712932db3', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1021f35-3b, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1021f35-3b, col_values=(('qos', UUID('241bf04e-d20c-4746-aeaf-a219d142d365')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1021f35-3b, col_values=(('external_ids', {'iface-id': 'b1021f35-3b88-4288-818c-325753086daf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b5:4a', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b')
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '601d3492-94f6-5dfc-acf3-27ecec43a7f5', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf5914b8-06, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf5914b8-06, col_values=(('qos', UUID('b30fc86b-ecb1-4882-bc3a-d03d6c9e560d')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf5914b8-06, col_values=(('external_ids', {'iface-id': 'cf5914b8-0656-47c2-ba2c-2fe6d04a6a65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:b0:8c', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06')
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '414f2e82-462e-56d2-83c6-3895eaf03515', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7a63db6-53, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7a63db6-53, col_values=(('qos', UUID('4b3cb5a8-f2ed-4ac0-81ea-f7c917cd3836')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7a63db6-53, col_values=(('external_ids', {'iface-id': 'a7a63db6-53d0-4e2f-acad-d649701a3f90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:e9:1e', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53')
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a72886f0-826c-5603-9db6-7b3823a4fbc2', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97c7e28d-01, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97c7e28d-01, col_values=(('qos', UUID('b3d729c4-4641-48de-bb41-01dc969dc95b')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97c7e28d-01, col_values=(('external_ids', {'iface-id': '97c7e28d-01ae-4b01-8594-2e507f37eeb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:f3:24', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01')
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e290d52-c8b5-5fae-b942-8df0dbe25a24', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e4ed8f6-1a, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e4ed8f6-1a, col_values=(('qos', UUID('9ebd1810-9847-4aa5-a2df-00192cf77a84')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e4ed8f6-1a, col_values=(('external_ids', {'iface-id': '7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:3a:b8', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a')
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c61a68d-4d6d-5e1f-a19c-bc631566d8f4', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6192ac90-a8, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6192ac90-a8, col_values=(('qos', UUID('eec4a95d-aab6-4bb1-b0a1-72e17d270e3d')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6192ac90-a8, col_values=(('external_ids', {'iface-id': '6192ac90-a8ff-46d9-914f-ab6894136423', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:a9:cc', 'vm-uuid': '04d6da52-74d4-4a87-b8b8-f5349354d8ee'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:55 user nova-compute[74870]: INFO os_vif [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8')
Nov 28 06:39:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] No BDM found with device name hda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] No VIF found with MAC fa:16:3e:52:47:ee, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] No VIF found with MAC fa:16:3e:e9:f3:24, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:39:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Using config drive
Nov 28 06:39:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Creating config drive at /opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee/disk.config
Nov 28 06:39:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp59k4ajnd {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp59k4ajnd" returned: 0 in 0.063s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:39:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:57 user nova-compute[74870]: WARNING nova.compute.manager [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance with vm_state building and task_state spawning.
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:58 user nova-compute[74870]: WARNING nova.compute.manager [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance with vm_state building and task_state spawning.
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:59 user nova-compute[74870]: WARNING nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance with vm_state building and task_state spawning.
Nov 28 06:39:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:59 user nova-compute[74870]: WARNING nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf for instance with vm_state building and task_state spawning.
Nov 28 06:39:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:39:59 user nova-compute[74870]: WARNING nova.compute.manager [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf for instance with vm_state building and task_state spawning.
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:39:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:00 user nova-compute[74870]: WARNING nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance with vm_state building and task_state spawning.
Nov 28 06:40:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:00 user nova-compute[74870]: WARNING nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance with vm_state building and task_state spawning.
Nov 28 06:40:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:00 user nova-compute[74870]: WARNING nova.compute.manager [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance with vm_state building and task_state spawning.
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:01 user nova-compute[74870]: WARNING nova.compute.manager [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance with vm_state building and task_state spawning.
Nov 28 06:40:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:01 user nova-compute[74870]: WARNING nova.compute.manager [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance with vm_state building and task_state spawning.
Nov 28 06:40:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:01 user nova-compute[74870]: WARNING nova.compute.manager [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance with vm_state building and task_state spawning.
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:40:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance spawned successfully.
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:02 user nova-compute[74870]: INFO nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Took 11.92 seconds to spawn the instance on the hypervisor.
Nov 28 06:40:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:02 user nova-compute[74870]: INFO nova.compute.manager [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Took 42.59 seconds to build instance.
Nov 28 06:40:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.775s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:03 user nova-compute[74870]: WARNING nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance with vm_state active and task_state None.
Nov 28 06:40:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:03 user nova-compute[74870]: WARNING nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 for instance with vm_state active and task_state None.
Nov 28 06:40:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:03 user nova-compute[74870]: WARNING nova.compute.manager [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 for instance with vm_state active and task_state None.
Nov 28 06:40:04 user nova-compute[74870]: INFO nova.compute.manager [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Rescuing
Nov 28 06:40:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:40:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-unplugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-unplugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:05 user nova-compute[74870]: WARNING nova.compute.manager [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-unplugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state active and task_state rescuing.
Nov 28 06:40:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "317be079-9b77-4139-88a4-36efb848c025" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:40:05 user nova-compute[74870]: INFO nova.compute.claims [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Claim successful on node user
Nov 28 06:40:05 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance destroyed successfully.
Nov 28 06:40:05 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Attempting rescue
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:40:05 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Creating image(s)
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.265s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue" returned: 0 in 0.062s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'migration_context' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.base [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<94a8f46d-3105-4486-a8b4-1409c9c544c7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Start _get_guest_xml network_info=[{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:35:bc:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'resources' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.base [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<94a8f46d-3105-4486-a8b4-1409c9c544c7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'numa_topology' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.base [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<94a8f46d-3105-4486-a8b4-1409c9c544c7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:40:06 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:06 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.base [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<94a8f46d-3105-4486-a8b4-1409c9c544c7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30674904',display_name='tempest-ServerRescueNegativeTestJSON-server-30674904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30674904',id=2,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-m4bo25mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:33Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=94a8f46d-3105-4486-a8b4-1409c9c544c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:35:bc:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:35:bc:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.objects.base [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<94a8f46d-3105-4486-a8b4-1409c9c544c7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:40:06 user nova-compute[74870]:   <uuid>94a8f46d-3105-4486-a8b4-1409c9c544c7</uuid>
Nov 28 06:40:06 user nova-compute[74870]:   <name>instance-00000002</name>
Nov 28 06:40:06 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:40:06 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:40:06 user nova-compute[74870]:   <metadata>
Nov 28 06:40:06 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:40:06 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:40:06 user nova-compute[74870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-30674904</nova:name>
Nov 28 06:40:06 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:40:06</nova:creationTime>
Nov 28 06:40:06 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:40:06 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:40:06 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:40:06 user nova-compute[74870]:       <nova:owner>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:user uuid="109001cce8ec4aa0b87f271b415cd5e6">tempest-ServerRescueNegativeTestJSON-226827849-project-member</nova:user>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:project uuid="8f90603ba77644568ec6f6fd37689a08">tempest-ServerRescueNegativeTestJSON-226827849</nova:project>
Nov 28 06:40:06 user nova-compute[74870]:       </nova:owner>
Nov 28 06:40:06 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:40:06 user nova-compute[74870]:       <nova:ports>
Nov 28 06:40:06 user nova-compute[74870]:         <nova:port uuid="ac8aece2-e749-4b38-8812-e9d4df591f41">
Nov 28 06:40:06 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 06:40:06 user nova-compute[74870]:         </nova:port>
Nov 28 06:40:06 user nova-compute[74870]:       </nova:ports>
Nov 28 06:40:06 user nova-compute[74870]:     </nova:instance>
Nov 28 06:40:06 user nova-compute[74870]:   </metadata>
Nov 28 06:40:06 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:40:06 user nova-compute[74870]:     <system>
Nov 28 06:40:06 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:40:06 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:40:06 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:40:06 user nova-compute[74870]:       <entry name="serial">94a8f46d-3105-4486-a8b4-1409c9c544c7</entry>
Nov 28 06:40:06 user nova-compute[74870]:       <entry name="uuid">94a8f46d-3105-4486-a8b4-1409c9c544c7</entry>
Nov 28 06:40:06 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:40:06 user nova-compute[74870]:     </system>
Nov 28 06:40:06 user nova-compute[74870]:   </sysinfo>
Nov 28 06:40:06 user nova-compute[74870]:   <os>
Nov 28 06:40:06 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:40:06 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:40:06 user nova-compute[74870]:   </os>
Nov 28 06:40:06 user nova-compute[74870]:   <features>
Nov 28 06:40:06 user nova-compute[74870]:     <acpi/>
Nov 28 06:40:06 user nova-compute[74870]:     <apic/>
Nov 28 06:40:06 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:40:06 user nova-compute[74870]:   </features>
Nov 28 06:40:06 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:40:06 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:40:06 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:40:06 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:40:06 user nova-compute[74870]:   </clock>
Nov 28 06:40:06 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:40:06 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:40:06 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:40:06 user nova-compute[74870]:   </cpu>
Nov 28 06:40:06 user nova-compute[74870]:   <devices>
Nov 28 06:40:06 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:40:06 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:40:06 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue"/>
Nov 28 06:40:06 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:40:06 user nova-compute[74870]:     </disk>
Nov 28 06:40:06 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:40:06 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:40:06 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk"/>
Nov 28 06:40:06 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:40:06 user nova-compute[74870]:     </disk>
Nov 28 06:40:06 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:40:06 user nova-compute[74870]:       <mac address="fa:16:3e:35:bc:d7"/>
Nov 28 06:40:06 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:06 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:40:06 user nova-compute[74870]:       <target dev="tapac8aece2-e7"/>
Nov 28 06:40:06 user nova-compute[74870]:     </interface>
Nov 28 06:40:06 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:40:06 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/console.log" append="off"/>
Nov 28 06:40:06 user nova-compute[74870]:     </serial>
Nov 28 06:40:06 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:40:06 user nova-compute[74870]:     <video>
Nov 28 06:40:06 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:06 user nova-compute[74870]:     </video>
Nov 28 06:40:06 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:40:06 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:40:06 user nova-compute[74870]:     </rng>
Nov 28 06:40:06 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:40:06 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:40:06 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:40:06 user nova-compute[74870]:     </memballoon>
Nov 28 06:40:06 user nova-compute[74870]:   </devices>
Nov 28 06:40:06 user nova-compute[74870]: </domain>
Nov 28 06:40:06 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:40:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance destroyed successfully.
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.750s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:35:bc:d7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.policy [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:40:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Creating image(s)
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "/opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "/opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "/opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Successfully created port: 61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk 1073741824" returned: 0 in 0.056s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:07 user nova-compute[74870]: WARNING nova.compute.manager [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state active and task_state rescuing.
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.compute.manager [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Cannot resize image /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Ensure instance console log exists: /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:07 user nova-compute[74870]: INFO nova.compute.manager [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] instance snapshotting
Nov 28 06:40:07 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Beginning live snapshot process
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Successfully updated port: 61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "refresh_cache-317be079-9b77-4139-88a4-36efb848c025" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquired lock "refresh_cache-317be079-9b77-4139-88a4-36efb848c025" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json -f qcow2" returned: 0 in 0.239s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Updating instance_info_cache with network_info: [{"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Releasing lock "refresh_cache-317be079-9b77-4139-88a4-36efb848c025" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Instance network_info: |[{"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Start _get_guest_xml network_info=[{"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:40:08 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:08 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1921302970',display_name='tempest-ServersNegativeTestJSON-server-1921302970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1921302970',id=13,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6362608255de47c3afa716e3091af3d0',ramdisk_id='',reservation_id='r-k2hszewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1666481027',owner_user_name='tempest-ServersNegativeTestJSON-1666481027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:06Z,user_data=None,user_id='5bd89a43a3bf4952a40cd1dd07de2442',uuid=317be079-9b77-4139-88a4-36efb848c025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converting VIF {"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lazy-loading 'pci_devices' on Instance uuid 317be079-9b77-4139-88a4-36efb848c025 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:40:08 user nova-compute[74870]:   <uuid>317be079-9b77-4139-88a4-36efb848c025</uuid>
Nov 28 06:40:08 user nova-compute[74870]:   <name>instance-0000000d</name>
Nov 28 06:40:08 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:40:08 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:40:08 user nova-compute[74870]:   <metadata>
Nov 28 06:40:08 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:40:08 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:40:08 user nova-compute[74870]:       <nova:name>tempest-ServersNegativeTestJSON-server-1921302970</nova:name>
Nov 28 06:40:08 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:40:08</nova:creationTime>
Nov 28 06:40:08 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:40:08 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:40:08 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:40:08 user nova-compute[74870]:       <nova:owner>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:user uuid="5bd89a43a3bf4952a40cd1dd07de2442">tempest-ServersNegativeTestJSON-1666481027-project-member</nova:user>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:project uuid="6362608255de47c3afa716e3091af3d0">tempest-ServersNegativeTestJSON-1666481027</nova:project>
Nov 28 06:40:08 user nova-compute[74870]:       </nova:owner>
Nov 28 06:40:08 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:40:08 user nova-compute[74870]:       <nova:ports>
Nov 28 06:40:08 user nova-compute[74870]:         <nova:port uuid="61814597-e5ae-41b8-9cfb-2de8d8f596ef">
Nov 28 06:40:08 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:40:08 user nova-compute[74870]:         </nova:port>
Nov 28 06:40:08 user nova-compute[74870]:       </nova:ports>
Nov 28 06:40:08 user nova-compute[74870]:     </nova:instance>
Nov 28 06:40:08 user nova-compute[74870]:   </metadata>
Nov 28 06:40:08 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:40:08 user nova-compute[74870]:     <system>
Nov 28 06:40:08 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:40:08 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:40:08 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:40:08 user nova-compute[74870]:       <entry name="serial">317be079-9b77-4139-88a4-36efb848c025</entry>
Nov 28 06:40:08 user nova-compute[74870]:       <entry name="uuid">317be079-9b77-4139-88a4-36efb848c025</entry>
Nov 28 06:40:08 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:40:08 user nova-compute[74870]:     </system>
Nov 28 06:40:08 user nova-compute[74870]:   </sysinfo>
Nov 28 06:40:08 user nova-compute[74870]:   <os>
Nov 28 06:40:08 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:40:08 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:40:08 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:40:08 user nova-compute[74870]:   </os>
Nov 28 06:40:08 user nova-compute[74870]:   <features>
Nov 28 06:40:08 user nova-compute[74870]:     <acpi/>
Nov 28 06:40:08 user nova-compute[74870]:     <apic/>
Nov 28 06:40:08 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:40:08 user nova-compute[74870]:   </features>
Nov 28 06:40:08 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:40:08 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:40:08 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:40:08 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:40:08 user nova-compute[74870]:   </clock>
Nov 28 06:40:08 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:40:08 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:40:08 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:40:08 user nova-compute[74870]:   </cpu>
Nov 28 06:40:08 user nova-compute[74870]:   <devices>
Nov 28 06:40:08 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:40:08 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:40:08 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk"/>
Nov 28 06:40:08 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:40:08 user nova-compute[74870]:     </disk>
Nov 28 06:40:08 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:40:08 user nova-compute[74870]:       <mac address="fa:16:3e:4e:e8:97"/>
Nov 28 06:40:08 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:08 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:40:08 user nova-compute[74870]:       <target dev="tap61814597-e5"/>
Nov 28 06:40:08 user nova-compute[74870]:     </interface>
Nov 28 06:40:08 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:40:08 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/console.log" append="off"/>
Nov 28 06:40:08 user nova-compute[74870]:     </serial>
Nov 28 06:40:08 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:40:08 user nova-compute[74870]:     <video>
Nov 28 06:40:08 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:08 user nova-compute[74870]:     </video>
Nov 28 06:40:08 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:40:08 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:40:08 user nova-compute[74870]:     </rng>
Nov 28 06:40:08 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:40:08 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:40:08 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:40:08 user nova-compute[74870]:     </memballoon>
Nov 28 06:40:08 user nova-compute[74870]:   </devices>
Nov 28 06:40:08 user nova-compute[74870]: </domain>
Nov 28 06:40:08 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1921302970',display_name='tempest-ServersNegativeTestJSON-server-1921302970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1921302970',id=13,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6362608255de47c3afa716e3091af3d0',ramdisk_id='',reservation_id='r-k2hszewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1666481027',owner_user_name='tempest-ServersNegativeTestJSON-1666481027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:06Z,user_data=None,user_id='5bd89a43a3bf4952a40cd1dd07de2442',uuid=317be079-9b77-4139-88a4-36efb848c025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converting VIF {"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG os_vif [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '713614ea-3556-51ee-bb36-22c97e130383', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61814597-e5, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61814597-e5, col_values=(('qos', UUID('b20056b4-0772-4162-a7e6-b99680eb7ddc')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61814597-e5, col_values=(('external_ids', {'iface-id': '61814597-e5ae-41b8-9cfb-2de8d8f596ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:e8:97', 'vm-uuid': '317be079-9b77-4139-88a4-36efb848c025'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: INFO os_vif [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5')
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] No VIF found with MAC fa:16:3e:4e:e8:97, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpusfwwi0x/a1b4c52c508e4fad9cc5203fc9a31601.delta 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpusfwwi0x/a1b4c52c508e4fad9cc5203fc9a31601.delta 1073741824" returned: 0 in 0.064s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:08 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 06:40:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74870) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 06:40:08 user nova-compute[74870]: INFO nova.virt.libvirt.host [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] UEFI support detected
Nov 28 06:40:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received event network-changed-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Refreshing instance network info cache due to event network-changed-61814597-e5ae-41b8-9cfb-2de8d8f596ef. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Acquiring lock "refresh_cache-317be079-9b77-4139-88a4-36efb848c025" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Acquired lock "refresh_cache-317be079-9b77-4139-88a4-36efb848c025" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:09 user nova-compute[74870]: DEBUG nova.network.neutron [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Refreshing network info cache for port 61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Updated VIF entry in instance network info cache for port 61814597-e5ae-41b8-9cfb-2de8d8f596ef. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Updating instance_info_cache with network_info: [{"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Releasing lock "refresh_cache-317be079-9b77-4139-88a4-36efb848c025" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:10 user nova-compute[74870]: WARNING nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state active and task_state rescuing.
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:10 user nova-compute[74870]: WARNING nova.compute.manager [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state active and task_state rescuing.
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] COPY block job progress, current cursor: 14417920 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:40:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 06:40:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received event network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] No waiting events found dispatching network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:11 user nova-compute[74870]: WARNING nova.compute.manager [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received unexpected event network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance with vm_state building and task_state spawning.
Nov 28 06:40:11 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpusfwwi0x/a1b4c52c508e4fad9cc5203fc9a31601.delta /opt/stack/data/nova/instances/snapshots/tmpusfwwi0x/a1b4c52c508e4fad9cc5203fc9a31601 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:40:11 user nova-compute[74870]: INFO nova.compute.claims [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Claim successful on node user
Nov 28 06:40:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpusfwwi0x/a1b4c52c508e4fad9cc5203fc9a31601.delta /opt/stack/data/nova/instances/snapshots/tmpusfwwi0x/a1b4c52c508e4fad9cc5203fc9a31601" returned: 0 in 0.731s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Snapshot extracted, beginning image upload
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-changed-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Refreshing instance network info cache due to event network-changed-717f616f-b485-4c7e-83be-a80086c19692. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.network.neutron [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Refreshing network info cache for port 717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.281s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:40:12 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.policy [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:40:12 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Creating image(s)
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "/opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "/opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "/opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.network.neutron [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updated VIF entry in instance network info cache for port 717f616f-b485-4c7e-83be-a80086c19692. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.network.neutron [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-changed-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Refreshing instance network info cache due to event network-changed-1a2f08f7-ca07-4148-a3d9-a9034157bd6a. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Acquiring lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Acquired lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.network.neutron [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Refreshing network info cache for port 1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk 1073741824" returned: 0 in 0.053s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:40:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 317be079-9b77-4139-88a4-36efb848c025] Instance spawned successfully.
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Successfully created port: 3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Cannot resize image /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Ensure instance console log exists: /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:13 user nova-compute[74870]: INFO nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 28 06:40:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:14 user nova-compute[74870]: INFO nova.compute.manager [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Took 8.54 seconds to build instance.
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "317be079-9b77-4139-88a4-36efb848c025" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.657s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updated VIF entry in instance network info cache for port 1a2f08f7-ca07-4148-a3d9-a9034157bd6a. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updating instance_info_cache with network_info: [{"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Releasing lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received event network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] No waiting events found dispatching network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:14 user nova-compute[74870]: WARNING nova.compute.manager [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received unexpected event network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance with vm_state building and task_state spawning.
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Successfully updated port: 3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquired lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.165s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:14 user nova-compute[74870]: INFO nova.compute.manager [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Attaching volume 53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 to /dev/vdb
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updating instance_info_cache with network_info: [{"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Releasing lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Instance network_info: |[{"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Start _get_guest_xml network_info=[{"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b283768-b0b5-4a27-9622-ab4237eb5653]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:15 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e17ab3-a530-497b-866b-d759654ee769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-797277048',display_name='tempest-TestStampPattern-server-797277048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-797277048',id=14,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A==',key_name='tempest-TestStampPattern-1173073735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48cff8da56da484d9dfee1b8118474b9',ramdisk_id='',reservation_id='r-w1mi775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-415121645',owner_user_name='tempest-TestStampPattern-415121645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:13Z,user_data=None,user_id='73373ee05e1b4e09b5c0870750a77262',uuid=8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converting VIF {"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'pci_devices' on Instance uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[032027f6-9aea-4a96-895e-a72cd79b114a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:40:15 user nova-compute[74870]:   <uuid>8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5</uuid>
Nov 28 06:40:15 user nova-compute[74870]:   <name>instance-0000000e</name>
Nov 28 06:40:15 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:40:15 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:40:15 user nova-compute[74870]:   <metadata>
Nov 28 06:40:15 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:40:15 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:40:15 user nova-compute[74870]:       <nova:name>tempest-TestStampPattern-server-797277048</nova:name>
Nov 28 06:40:15 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:40:15</nova:creationTime>
Nov 28 06:40:15 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:40:15 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:40:15 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:40:15 user nova-compute[74870]:       <nova:owner>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:user uuid="73373ee05e1b4e09b5c0870750a77262">tempest-TestStampPattern-415121645-project-member</nova:user>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:project uuid="48cff8da56da484d9dfee1b8118474b9">tempest-TestStampPattern-415121645</nova:project>
Nov 28 06:40:15 user nova-compute[74870]:       </nova:owner>
Nov 28 06:40:15 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:40:15 user nova-compute[74870]:       <nova:ports>
Nov 28 06:40:15 user nova-compute[74870]:         <nova:port uuid="3910f97d-105a-4142-a3ab-effc57185190">
Nov 28 06:40:15 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 06:40:15 user nova-compute[74870]:         </nova:port>
Nov 28 06:40:15 user nova-compute[74870]:       </nova:ports>
Nov 28 06:40:15 user nova-compute[74870]:     </nova:instance>
Nov 28 06:40:15 user nova-compute[74870]:   </metadata>
Nov 28 06:40:15 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:40:15 user nova-compute[74870]:     <system>
Nov 28 06:40:15 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:40:15 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:40:15 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:40:15 user nova-compute[74870]:       <entry name="serial">8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5</entry>
Nov 28 06:40:15 user nova-compute[74870]:       <entry name="uuid">8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5</entry>
Nov 28 06:40:15 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:40:15 user nova-compute[74870]:     </system>
Nov 28 06:40:15 user nova-compute[74870]:   </sysinfo>
Nov 28 06:40:15 user nova-compute[74870]:   <os>
Nov 28 06:40:15 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:40:15 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:40:15 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:40:15 user nova-compute[74870]:   </os>
Nov 28 06:40:15 user nova-compute[74870]:   <features>
Nov 28 06:40:15 user nova-compute[74870]:     <acpi/>
Nov 28 06:40:15 user nova-compute[74870]:     <apic/>
Nov 28 06:40:15 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:40:15 user nova-compute[74870]:   </features>
Nov 28 06:40:15 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:40:15 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:40:15 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:40:15 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:40:15 user nova-compute[74870]:   </clock>
Nov 28 06:40:15 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:40:15 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:40:15 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:40:15 user nova-compute[74870]:   </cpu>
Nov 28 06:40:15 user nova-compute[74870]:   <devices>
Nov 28 06:40:15 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:40:15 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:40:15 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk"/>
Nov 28 06:40:15 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:40:15 user nova-compute[74870]:     </disk>
Nov 28 06:40:15 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:40:15 user nova-compute[74870]:       <mac address="fa:16:3e:ba:9d:ef"/>
Nov 28 06:40:15 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:15 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:40:15 user nova-compute[74870]:       <target dev="tap3910f97d-10"/>
Nov 28 06:40:15 user nova-compute[74870]:     </interface>
Nov 28 06:40:15 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:40:15 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/console.log" append="off"/>
Nov 28 06:40:15 user nova-compute[74870]:     </serial>
Nov 28 06:40:15 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:40:15 user nova-compute[74870]:     <video>
Nov 28 06:40:15 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:15 user nova-compute[74870]:     </video>
Nov 28 06:40:15 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:40:15 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:40:15 user nova-compute[74870]:     </rng>
Nov 28 06:40:15 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:40:15 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:40:15 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:40:15 user nova-compute[74870]:     </memballoon>
Nov 28 06:40:15 user nova-compute[74870]:   </devices>
Nov 28 06:40:15 user nova-compute[74870]: </domain>
Nov 28 06:40:15 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-797277048',display_name='tempest-TestStampPattern-server-797277048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-797277048',id=14,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A==',key_name='tempest-TestStampPattern-1173073735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48cff8da56da484d9dfee1b8118474b9',ramdisk_id='',reservation_id='r-w1mi775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-415121645',owner_user_name='tempest-TestStampPattern-415121645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:13Z,user_data=None,user_id='73373ee05e1b4e09b5c0870750a77262',uuid=8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converting VIF {"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG os_vif [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b354d664-3eb2-5c94-af6b-c750d5b58546', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2a6e99-9c6d-4170-88eb-2e24add0ce79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3910f97d-10, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3910f97d-10, col_values=(('qos', UUID('c488e569-602b-41f1-9e12-10f3b7e83784')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3910f97d-10, col_values=(('external_ids', {'iface-id': '3910f97d-105a-4142-a3ab-effc57185190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:9d:ef', 'vm-uuid': '8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:15 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e06bd36-ecc8-4105-9fef-75c34f1d5df9]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG os_brick.utils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== get_connector_properties: return (284ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updating existing volume attachment record: d936cbb1-ea42-4cda-ab6b-a9b06f4f9cdf {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:40:15 user nova-compute[74870]: INFO os_vif [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10')
Nov 28 06:40:15 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Snapshot image upload complete
Nov 28 06:40:15 user nova-compute[74870]: INFO nova.compute.manager [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Took 7.83 seconds to snapshot the instance on the hypervisor.
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-changed-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Refreshing instance network info cache due to event network-changed-3910f97d-105a-4142-a3ab-effc57185190. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Acquiring lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Acquired lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Refreshing network info cache for port 3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No VIF found with MAC fa:16:3e:ba:9d:ef, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updated VIF entry in instance network info cache for port 3910f97d-105a-4142-a3ab-effc57185190. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updating instance_info_cache with network_info: [{"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Releasing lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.299s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] No waiting events found dispatching network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:17 user nova-compute[74870]: WARNING nova.compute.manager [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received unexpected event network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 for instance with vm_state building and task_state spawning.
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] No waiting events found dispatching network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:19 user nova-compute[74870]: WARNING nova.compute.manager [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received unexpected event network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 for instance with vm_state building and task_state spawning.
Nov 28 06:40:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing instance network info cache due to event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.529s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:20 user nova-compute[74870]: INFO nova.compute.manager [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] instance snapshotting
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG nova.network.neutron [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updated VIF entry in instance network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG nova.network.neutron [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:40:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Instance spawned successfully.
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Beginning live snapshot process
Nov 28 06:40:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:40:21 user nova-compute[74870]: INFO nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:21 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=6690MB free_disk=25.647361755371094GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:21 user nova-compute[74870]: INFO nova.compute.manager [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Took 10.59 seconds to build instance.
Nov 28 06:40:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.786s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance b4802806-6422-46da-8d0f-5674af0a8433 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e3406c2b-4e6e-4be0-b84a-168c59322f00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 70280af1-c742-4096-9abc-7a1ca9b44079 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 317be079-9b77-4139-88a4-36efb848c025 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.242s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv3f6s39l/08e2430bac0f4135a63275ff24a8f014.delta 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv3f6s39l/08e2430bac0f4135a63275ff24a8f014.delta 1073741824" returned: 0 in 0.074s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:40:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.914s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRlUZyJL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:23 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b360cbd7-d1ce-4071-a451-015fe8e50f5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:40:23 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[266df085-6d04-4662-a2cc-b2296609af1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2] added
Nov 28 06:40:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c8c48-f1c5-424b-8fdd-f662f24c5707]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f9ae6-5687-4322-9092-c6ac7d0b5fde]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRlUZyJL {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:40:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRlUZyJL" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8ebd2-4742-4ac8-8948-6e5bdb0f6888]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRlUZyJL'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d0ed9-af90-49f0-8328-56120b8543bd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28feb6d7-1ad9-4da3-a5a6-0640023a4583]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv3f6s39l/08e2430bac0f4135a63275ff24a8f014.delta /opt/stack/data/nova/instances/snapshots/tmpv3f6s39l/08e2430bac0f4135a63275ff24a8f014 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d21827e-8b9b-4f23-a9e3-53652594436e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260]
Nov 28 06:40:24 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260] successful.
Nov 28 06:40:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87632262-b650-492c-a6e3-74ed455cdc62]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f6f5c-a969-430f-acba-fb91c1bf2744]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.128s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[78731a55-9ae3-4387-ba4a-eda0b9c7b536]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRlUZyJL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:40:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv3f6s39l/08e2430bac0f4135a63275ff24a8f014.delta /opt/stack/data/nova/instances/snapshots/tmpv3f6s39l/08e2430bac0f4135a63275ff24a8f014" returned: 0 in 0.384s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:24 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Snapshot extracted, beginning image upload
Nov 28 06:40:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '23563383465613230', 'path': '/dev/sdf'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563383465613230', 'path': '/dev/sdf'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:40:25 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:40:25 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:25 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:40:25 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:25 user nova-compute[74870]:   <serial>53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2</serial>
Nov 28 06:40:25 user nova-compute[74870]: </disk>
Nov 28 06:40:25 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:40:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:1b:24:e7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.581s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Snapshot image upload complete
Nov 28 06:40:27 user nova-compute[74870]: INFO nova.compute.manager [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Took 6.61 seconds to snapshot the instance on the hypervisor.
Nov 28 06:40:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b30131e3-a805-4fbc-815c-7e379c44a386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:40:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:30 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:40:30 user nova-compute[74870]: INFO nova.compute.claims [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Claim successful on node user
Nov 28 06:40:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.885s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:40:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.policy [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:40:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Creating image(s)
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "/opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.227s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk 1073741824" returned: 0 in 0.063s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Successfully created port: 8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-changed-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Refreshing instance network info cache due to event network-changed-519d15c3-a87c-436b-aa7d-b6754a055382. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Acquiring lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Acquired lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Refreshing network info cache for port 519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Cannot resize image /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Ensure instance console log exists: /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updated VIF entry in instance network info cache for port 519d15c3-a87c-436b-aa7d-b6754a055382. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updating instance_info_cache with network_info: [{"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Releasing lock "refresh_cache-636fad3b-617f-4a65-8cf7-ef67fd68304b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Successfully updated port: 8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquired lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-changed-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Refreshing instance network info cache due to event network-changed-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Acquiring lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Updating instance_info_cache with network_info: [{"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Releasing lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Instance network_info: |[{"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Acquired lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Refreshing network info cache for port 8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Start _get_guest_xml network_info=[{"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:40:33 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:33 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-184058363',display_name='tempest-AttachVolumeNegativeTest-server-184058363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-184058363',id=15,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoHWATyOznTa3QISkPxYic5CYo5gMvAHv39uglMQOy4R4C3vYAKpZGMik0+X0Bvm/kPlXlGSrDPHEXQdQpRBI9+0O95dTnBB1+GuFPUbKtFKHp29bFKjhno/xwR6OeWhA==',key_name='tempest-keypair-1335441825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-gmx3oh2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=b30131e3-a805-4fbc-815c-7e379c44a386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'pci_devices' on Instance uuid b30131e3-a805-4fbc-815c-7e379c44a386 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:40:33 user nova-compute[74870]:   <uuid>b30131e3-a805-4fbc-815c-7e379c44a386</uuid>
Nov 28 06:40:33 user nova-compute[74870]:   <name>instance-0000000f</name>
Nov 28 06:40:33 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:40:33 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:40:33 user nova-compute[74870]:   <metadata>
Nov 28 06:40:33 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:40:33 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:40:33 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-184058363</nova:name>
Nov 28 06:40:33 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:40:33</nova:creationTime>
Nov 28 06:40:33 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:40:33 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:40:33 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:40:33 user nova-compute[74870]:       <nova:owner>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:user uuid="05e396090c4b4a8995d8d2e66c8b3db0">tempest-AttachVolumeNegativeTest-538884229-project-member</nova:user>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:project uuid="5df9ec769206481e8dad48a6461c46ba">tempest-AttachVolumeNegativeTest-538884229</nova:project>
Nov 28 06:40:33 user nova-compute[74870]:       </nova:owner>
Nov 28 06:40:33 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:40:33 user nova-compute[74870]:       <nova:ports>
Nov 28 06:40:33 user nova-compute[74870]:         <nova:port uuid="8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0">
Nov 28 06:40:33 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 06:40:33 user nova-compute[74870]:         </nova:port>
Nov 28 06:40:33 user nova-compute[74870]:       </nova:ports>
Nov 28 06:40:33 user nova-compute[74870]:     </nova:instance>
Nov 28 06:40:33 user nova-compute[74870]:   </metadata>
Nov 28 06:40:33 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:40:33 user nova-compute[74870]:     <system>
Nov 28 06:40:33 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:40:33 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:40:33 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:40:33 user nova-compute[74870]:       <entry name="serial">b30131e3-a805-4fbc-815c-7e379c44a386</entry>
Nov 28 06:40:33 user nova-compute[74870]:       <entry name="uuid">b30131e3-a805-4fbc-815c-7e379c44a386</entry>
Nov 28 06:40:33 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:40:33 user nova-compute[74870]:     </system>
Nov 28 06:40:33 user nova-compute[74870]:   </sysinfo>
Nov 28 06:40:33 user nova-compute[74870]:   <os>
Nov 28 06:40:33 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:40:33 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:40:33 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:40:33 user nova-compute[74870]:   </os>
Nov 28 06:40:33 user nova-compute[74870]:   <features>
Nov 28 06:40:33 user nova-compute[74870]:     <acpi/>
Nov 28 06:40:33 user nova-compute[74870]:     <apic/>
Nov 28 06:40:33 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:40:33 user nova-compute[74870]:   </features>
Nov 28 06:40:33 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:40:33 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:40:33 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:40:33 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:40:33 user nova-compute[74870]:   </clock>
Nov 28 06:40:33 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:40:33 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:40:33 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:40:33 user nova-compute[74870]:   </cpu>
Nov 28 06:40:33 user nova-compute[74870]:   <devices>
Nov 28 06:40:33 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:40:33 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:40:33 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk"/>
Nov 28 06:40:33 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:40:33 user nova-compute[74870]:     </disk>
Nov 28 06:40:33 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:40:33 user nova-compute[74870]:       <mac address="fa:16:3e:eb:02:de"/>
Nov 28 06:40:33 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:33 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:40:33 user nova-compute[74870]:       <target dev="tap8bf5bfdf-5d"/>
Nov 28 06:40:33 user nova-compute[74870]:     </interface>
Nov 28 06:40:33 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:40:33 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/console.log" append="off"/>
Nov 28 06:40:33 user nova-compute[74870]:     </serial>
Nov 28 06:40:33 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:40:33 user nova-compute[74870]:     <video>
Nov 28 06:40:33 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:40:33 user nova-compute[74870]:     </video>
Nov 28 06:40:33 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:40:33 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:40:33 user nova-compute[74870]:     </rng>
Nov 28 06:40:33 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:40:33 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:40:33 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:40:33 user nova-compute[74870]:     </memballoon>
Nov 28 06:40:33 user nova-compute[74870]:   </devices>
Nov 28 06:40:33 user nova-compute[74870]: </domain>
Nov 28 06:40:33 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-184058363',display_name='tempest-AttachVolumeNegativeTest-server-184058363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-184058363',id=15,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoHWATyOznTa3QISkPxYic5CYo5gMvAHv39uglMQOy4R4C3vYAKpZGMik0+X0Bvm/kPlXlGSrDPHEXQdQpRBI9+0O95dTnBB1+GuFPUbKtFKHp29bFKjhno/xwR6OeWhA==',key_name='tempest-keypair-1335441825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-gmx3oh2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=b30131e3-a805-4fbc-815c-7e379c44a386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG os_vif [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3f9875b-3abf-588c-8f3f-7a0e52556bed', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bf5bfdf-5d, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bf5bfdf-5d, col_values=(('qos', UUID('0cdace58-aa91-49cc-8803-295c77acbd8c')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bf5bfdf-5d, col_values=(('external_ids', {'iface-id': '8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:02:de', 'vm-uuid': 'b30131e3-a805-4fbc-815c-7e379c44a386'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: INFO os_vif [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d')
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:eb:02:de, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Updated VIF entry in instance network info cache for port 8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Updating instance_info_cache with network_info: [{"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Releasing lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'flavor' on Instance uuid 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] No waiting events found dispatching network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:35 user nova-compute[74870]: WARNING nova.compute.manager [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received unexpected event network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance with vm_state building and task_state spawning.
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:35 user nova-compute[74870]: INFO nova.compute.manager [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Attaching volume 0a7285f6-0c7b-4de0-a44d-fc22c9226685 to /dev/vdb
Nov 28 06:40:35 user nova-compute[74870]: DEBUG os_brick.utils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc926b-a9f8-4fb1-8928-9e4d987a28ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fcd19f-8948-40d6-8cce-64397438866c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a3eba6-32d9-486d-a9d4-2c52df562dfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47434a3b-2f9d-4681-bcc5-b4e7149df3b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:35 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:40:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a08261-5cbc-491a-ae86-396c359e99a0]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG os_brick.utils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:35 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updating existing volume attachment record: f40dfafe-7a7a-44e4-945c-7bafa07ece51 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] No waiting events found dispatching network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:37 user nova-compute[74870]: WARNING nova.compute.manager [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received unexpected event network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance with vm_state building and task_state spawning.
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:40:37 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Instance spawned successfully.
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:40:37 user nova-compute[74870]: INFO nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 28 06:40:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:37 user nova-compute[74870]: INFO nova.compute.manager [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Took 7.33 seconds to build instance.
Nov 28 06:40:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b30131e3-a805-4fbc-815c-7e379c44a386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-changed-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Refreshing instance network info cache due to event network-changed-affac6e2-50a7-44d2-b7ba-ec18341bb71f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Acquiring lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Acquired lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Refreshing network info cache for port affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lazy-loading 'flavor' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updated VIF entry in instance network info cache for port affac6e2-50a7-44d2-b7ba-ec18341bb71f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updating instance_info_cache with network_info: [{"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Releasing lock "refresh_cache-66c94c69-4907-404d-ad02-d8ba2716a4e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:40 user nova-compute[74870]: INFO nova.compute.manager [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Attaching volume d6b27c97-e46a-41e7-8096-86cbe43a8b11 to /dev/vdb
Nov 28 06:40:40 user nova-compute[74870]: DEBUG os_brick.utils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9693087-b1b2-441d-a4e5-58ae85690bc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a2de33-ca58-43e1-9df3-2154229bfe40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f18ca8-ad33-4e66-a923-3815df4a94e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec67af-3edb-4579-a50b-00f5f97c539d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:40 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:40:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22cede-3079-4cb1-a8aa-a9074062aa8f]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG os_brick.utils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:40 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updating existing volume attachment record: d68f292a-f5fd-4e1f-9aff-edce3730a71b {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:40:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:40:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeJBnSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:42 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:42 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:42 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:40:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[973b900f-cddf-4b40-bfe8-492262432050]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:40:43 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f2f71-e0d7-4876-a2ea-e1ab36a8911d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685] added
Nov 28 06:40:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.123s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dd7249-a277-49d1-abc4-4cb8e384b4de]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207c52c-275f-47ed-9ddd-9cd0ebd053c7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTeJBnSp {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTeJBnSp" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20d24d3-8b6c-423c-ae67-bafef1aeb15a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTeJBnSp'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b842d33-7900-4fa0-a427-c7ede14ba04f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec8696-131c-4ce2-8b92-cf287bf42902]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b48c0-51d8-4694-acf5-4eb7f256db26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260]
Nov 28 06:40:43 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260] successful.
Nov 28 06:40:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[972b6154-8f40-45d5-985f-ffad737315e1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d84138-ba45-45c1-9ec8-fd8ce90645f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[423bf442-6e6d-413f-a318-aa9ef87d8397]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeJBnSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:40:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23234336531396634', 'path': '/dev/sdg'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234336531396634', 'path': '/dev/sdg'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'flavor' on Instance uuid 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:40:44 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:44 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:40:44 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:44 user nova-compute[74870]:   <serial>0a7285f6-0c7b-4de0-a44d-fc22c9226685</serial>
Nov 28 06:40:44 user nova-compute[74870]: </disk>
Nov 28 06:40:44 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No VIF found with MAC fa:16:3e:dd:8c:b1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.742s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-changed-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Refreshing instance network info cache due to event network-changed-44cb2e46-5eae-4728-ac61-29177ecb06f6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Acquiring lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Acquired lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG nova.network.neutron [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Refreshing network info cache for port 44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:45 user nova-compute[74870]: DEBUG nova.objects.instance [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lazy-loading 'flavor' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG nova.network.neutron [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updated VIF entry in instance network info cache for port 44cb2e46-5eae-4728-ac61-29177ecb06f6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG nova.network.neutron [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updating instance_info_cache with network_info: [{"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Releasing lock "refresh_cache-e3406c2b-4e6e-4be0-b84a-168c59322f00" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:46 user nova-compute[74870]: INFO nova.compute.manager [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Attaching volume 66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 to /dev/vdb
Nov 28 06:40:46 user nova-compute[74870]: DEBUG os_brick.utils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6c977-2b9c-405f-92dd-8d819ca51348]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b30cc-dc7c-490c-a7d6-f37941e63565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2dfe13-9689-45a7-8042-11747cee5e30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[57540464-779e-4773-a658-64f7e63b689f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:46 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b74fc9e-9fcb-463f-ad2c-4b39b2d902d1]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG os_brick.utils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updating existing volume attachment record: 277aca11-d4f5-4f33-9cd4-2d80e63bf34b {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:46 user nova-compute[74870]: INFO nova.compute.manager [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Detaching volume 0a7285f6-0c7b-4de0-a44d-fc22c9226685
Nov 28 06:40:46 user nova-compute[74870]: INFO nova.virt.block_device [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Attempting to driver detach volume 0a7285f6-0c7b-4de0-a44d-fc22c9226685 from mountpoint /dev/vdb
Nov 28 06:40:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Attempting to detach device vdb from instance 636fad3b-617f-4a65-8cf7-ef67fd68304b from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:40:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:40:46 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:46 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:40:46 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:46 user nova-compute[74870]:   <serial>0a7285f6-0c7b-4de0-a44d-fc22c9226685</serial>
Nov 28 06:40:46 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:40:46 user nova-compute[74870]: </disk>
Nov 28 06:40:46 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:40:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Successfully detached device vdb from instance 636fad3b-617f-4a65-8cf7-ef67fd68304b from the persistent domain config.
Nov 28 06:40:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 636fad3b-617f-4a65-8cf7-ef67fd68304b from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:40:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:40:47 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:47 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:40:47 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:47 user nova-compute[74870]:   <serial>0a7285f6-0c7b-4de0-a44d-fc22c9226685</serial>
Nov 28 06:40:47 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:40:47 user nova-compute[74870]: </disk>
Nov 28 06:40:47 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:40:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:48 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b973a9b-da78-49e4-a70e-abd3286f94ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:40:48 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[864767cf-d071-4a82-8129-da51334d21fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11] added
Nov 28 06:40:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb77f2-d9b8-43de-852d-dad70b64bd06]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a764a2d-2cfd-4c5c-82d4-8429a16b606b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbEUJYRq {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbEUJYRq" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eee154-dc39-447e-af48-87fb18617a37]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DbEUJYRq'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c9a19-0b62-4529-8e3e-542450df5b00]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c3a320-1e5a-43f9-a227-5faeca89f646]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02095b50-51fa-48ba-a7d6-a1f6e42d0bc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]
Nov 28 06:40:48 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.
Nov 28 06:40:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4085b83-365a-457e-91c9-d6ab32d557ba]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db797c-71bb-4ae2-a2f8-37df4045434c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f25336-218a-43a1-abd0-75e294253213]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:40:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:40:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26161313438303434', 'path': '/dev/sdh'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313438303434', 'path': '/dev/sdh'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:40:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lazy-loading 'flavor' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:40:49 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:49 user nova-compute[74870]:   <source dev="/dev/sdh"/>
Nov 28 06:40:49 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:49 user nova-compute[74870]:   <serial>d6b27c97-e46a-41e7-8096-86cbe43a8b11</serial>
Nov 28 06:40:49 user nova-compute[74870]: </disk>
Nov 28 06:40:49 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:40:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] No VIF found with MAC fa:16:3e:65:c4:d1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.650s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG os_brick.utils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f50f29-180c-45ff-a7e6-6acf0492d9b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab92c9-39e3-40b6-812b-67148bc941d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f3af4-aa8b-45ad-9867-c287924f18d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec24887b-400d-41e5-9038-9ad80c1adc56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:40:51 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:40:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6116af-f3ce-4cd9-8350-e98598e2a37b]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:40:51 user nova-compute[74870]: DEBUG os_brick.utils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:51 user nova-compute[74870]: INFO nova.compute.manager [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Swapping volume d6b27c97-e46a-41e7-8096-86cbe43a8b11 for a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:40:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-changed-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Refreshing instance network info cache due to event network-changed-e8244d47-16b3-4035-8877-b5d7b137dea6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Acquiring lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Acquired lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Refreshing network info cache for port e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updated VIF entry in instance network info cache for port e8244d47-16b3-4035-8877-b5d7b137dea6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updating instance_info_cache with network_info: [{"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:40:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Releasing lock "refresh_cache-70280af1-c742-4096-9abc-7a1ca9b44079" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:53 user nova-compute[74870]: INFO nova.compute.manager [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Rebuilding instance
Nov 28 06:40:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdnYrXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:54 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6482b19-a279-4906-88fa-39ce922723ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:40:54 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-unplugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-unplugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:54 user nova-compute[74870]: WARNING nova.compute.manager [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-unplugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state active and task_state rebuilding.
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0612d0e8-ec7e-4522-8fc7-7352d2efc303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1] added
Nov 28 06:40:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e9a676-ba62-4714-af31-e5d3290c153e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e49e31-df9a-443c-9f91-36029f7875a7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdnYrXbJ {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdnYrXbJ" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9426705e-5ec1-40f7-a1ce-34381f443ec1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdnYrXbJ'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5539815-5ff6-41b7-b13d-1093ad33dbc1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43ec754-4b12-4438-a3f3-735473fb4ed1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1c7d9-e544-4f3b-ad3f-fcbf0c200093]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260]
Nov 28 06:40:54 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260] successful.
Nov 28 06:40:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc943beb-05d4-41cc-ad3b-707f86490410]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b227cdc-9bab-4914-8e84-a33a7f495978]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7743a950-910c-4c8f-bdeb-170939330a0c]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdnYrXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:40:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance destroyed successfully.
Nov 28 06:40:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance destroyed successfully.
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1780739755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1245407202',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg==',key_name='tempest-keypair-885228878',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff4ac048770a4680a35f71465d191d49',ramdisk_id='',reservation_id='r-l9wr9xfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-960022347',owner_user_name='tempest-ServerActionsV293TestJSON-960022347-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48e7c51916684bec98970a963f2c560e',uuid=70280af1-c742-4096-9abc-7a1ca9b44079,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converting VIF {"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8244d47-16, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b6a7ab-cbfa-4d4b-b88d-9bf439859453) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:54 user nova-compute[74870]: INFO os_vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16')
Nov 28 06:40:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:40:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26263376365353132', 'path': '/dev/sdi'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263376365353132', 'path': '/dev/sdi'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.806s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.objects.instance [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lazy-loading 'flavor' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e599e-f90b-4435-806b-0831f6d990b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:40:55 user nova-compute[74870]: No targets found.
Nov 28 06:40:55 user nova-compute[74870]: iSNS:
Nov 28 06:40:55 user nova-compute[74870]: No targets found.
Nov 28 06:40:55 user nova-compute[74870]: STATIC:
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: FIRMWARE:
Nov 28 06:40:55 user nova-compute[74870]: No targets found.
Nov 28 06:40:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:40:55 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:40:55 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b52eaf-f3a3-40c6-beec-5ec9b06930d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 06:40:55 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:55 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:40:55 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:55 user nova-compute[74870]:   <serial>66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1</serial>
Nov 28 06:40:55 user nova-compute[74870]: </disk>
Nov 28 06:40:55 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50dcee9-2fd9-40f8-b76a-80e3c8a30e9f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc324700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc1184-cbd0-4529-a2bb-9f7160230777]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafde13b-f756-4185-9b83-53ae0db40224]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed999dd-ec92-4027-9ed8-9906e0eded77]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92960ec1-6e75-4228-9ea9-1bb4e060763d]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23c1e5-28e3-47cf-bc15-ac7ab1dfbc3f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d75d29-4dee-4130-bea3-9d58ec53ffbe]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]
Nov 28 06:40:55 user nova-compute[74870]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.
Nov 28 06:40:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2850e-457f-4d00-a5f6-669b5a1e4a5e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== disconnect_volume: return (1146ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:40:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Deleting instance files /opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079_del
Nov 28 06:40:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Deletion of /opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079_del complete
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] No VIF found with MAC fa:16:3e:e9:e0:dc, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:40:55 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 70280af1-c742-4096-9abc-7a1ca9b44079 could not be found.
Nov 28 06:40:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:55 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b488dcfe-f69f-4032-b621-c5ffee4382fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:40:55 user nova-compute[74870]: No targets found.
Nov 28 06:40:55 user nova-compute[74870]: iSNS:
Nov 28 06:40:55 user nova-compute[74870]: No targets found.
Nov 28 06:40:55 user nova-compute[74870]: STATIC:
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c
Nov 28 06:40:55 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:40:55 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:40:55 user nova-compute[74870]: FIRMWARE:
Nov 28 06:40:55 user nova-compute[74870]: No targets found.
Nov 28 06:40:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:40:56 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:40:56 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.702s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60fa14e-c32c-4e86-a94a-1b17a67fee7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ca1dc-c023-4751-ab0f-c597646bd364]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc2db0a0>, {}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Disconnecting from: [] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== disconnect_volume: return (87ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:40:56 user nova-compute[74870]: WARNING nova.compute.manager [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state active and task_state rebuilding.
Nov 28 06:40:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Preparing to wait for external event volume-reimaged-1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 {{(pid=74870) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] volume_snapshot_create: create_info: {'snapshot_id': '1825bcbe-1f09-4f29-bb6e-ceaa81c66152', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74870) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] snap xml: <domainsnapshot>
Nov 28 06:40:57 user nova-compute[74870]:   <disks>
Nov 28 06:40:57 user nova-compute[74870]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 28 06:40:57 user nova-compute[74870]:       <source file="/dev/new_file"/>
Nov 28 06:40:57 user nova-compute[74870]:     </disk>
Nov 28 06:40:57 user nova-compute[74870]:     <disk name="vda" snapshot="no"/>
Nov 28 06:40:57 user nova-compute[74870]:   </disks>
Nov 28 06:40:57 user nova-compute[74870]: </domainsnapshot>
Nov 28 06:40:57 user nova-compute[74870]:  {{(pid=74870) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.objects.instance [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lazy-loading 'system_metadata' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:40:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] volume_snapshot_delete: delete_info: {'volume_id': '66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1'} {{(pid=74870) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     if delete_info['type'] != 'qcow2':
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] KeyError: 'type'
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     rv = execute(f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     six.reraise(c, e, tb)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     raise value
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     rv = meth(*args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     self._volume_snapshot_create(context, instance, guest,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     rv = execute(f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     six.reraise(c, e, tb)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     raise value
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     rv = meth(*args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-850d5aa6-2d7f-46d3-bb5f-4d38639d642a)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Exception during message handling: KeyError: 'type'
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1825bcbe-1f09-4f29-bb6e-ceaa81c66152 could not be found.
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1825bcbe-1f09-4f29-bb6e-ceaa81c66152 could not be found. (HTTP 404) (Request-ID: req-d1ad00ef-0d2d-44a0-97d6-0b94f22948ee)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1825bcbe-1f09-4f29-bb6e-ceaa81c66152 could not be found.
Nov 28 06:40:57 user nova-compute[74870]: ERROR nova.virt.libvirt.driver 
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 06:40:57 user nova-compute[74870]: ERROR oslo_messaging.rpc.server 
Nov 28 06:40:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:40:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:40:57 user nova-compute[74870]: INFO nova.compute.manager [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Detaching volume 66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:40:57 user nova-compute[74870]: INFO nova.virt.block_device [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Attempting to driver detach volume 66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 from mountpoint /dev/vdb
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Attempting to detach device vdb from instance e3406c2b-4e6e-4be0-b84a-168c59322f00 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 06:40:57 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:57 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:40:57 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:57 user nova-compute[74870]:   <serial>66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1</serial>
Nov 28 06:40:57 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:40:57 user nova-compute[74870]: </disk>
Nov 28 06:40:57 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:40:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Successfully detached device vdb from instance e3406c2b-4e6e-4be0-b84a-168c59322f00 from the persistent domain config.
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3406c2b-4e6e-4be0-b84a-168c59322f00 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:40:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 06:40:57 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:40:57 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:40:57 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:40:57 user nova-compute[74870]:   <serial>66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1</serial>
Nov 28 06:40:57 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:40:57 user nova-compute[74870]: </disk>
Nov 28 06:40:57 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:40:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:40:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPFSgHDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66c94c69-4907-404d-ad02-d8ba2716a4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a60faa57-ed99-4b91-933b-a8f84da07af0', 'serial': 'a60faa57-ed99-4b91-933b-a8f84da07af0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '66c94c69-4907-404d-ad02-d8ba2716a4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6b27c97-e46a-41e7-8096-86cbe43a8b11', 'serial'} {{(pid=74870) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPFSgHDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:40:59 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:59 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:40:59 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[464a8507-afee-48fc-b0e6-7c01a8d77496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:40:59 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b6e3ee-bf76-48da-b1e0-35308204bbfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0] added
Nov 28 06:40:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfeea5e-97a6-47c7-9eea-97403458083b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60da1f0-60eb-4898-be39-225074bbe4a4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPFSgHDJ {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPFSgHDJ" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c5e24-60a7-4288-aefa-fc6a803abac9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RPFSgHDJ'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[567afb22-1bfd-4403-a3b5-e5b94b3f0255]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7822e1ce-b35f-4068-bfa6-ba035b81e8e3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e84e14-1e89-45a0-90d1-981715bc3d0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260]
Nov 28 06:40:59 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260] successful.
Nov 28 06:40:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93971c1-08d5-42a0-900c-4da0a56a821c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb03000-62d8-4107-a2e8-2962ac892962]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:40:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88951ee-a734-48a8-81d4-fd29409943dc]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPFSgHDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:40:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:00 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:00 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23737383966633062', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737383966633062', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:41:00 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lazy-loading 'flavor' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 265289728 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 436207616 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 580911104 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 735051776 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:05 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd80a4a-d75b-42da-8263-ceca528024b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:05 user nova-compute[74870]: No targets found.
Nov 28 06:41:05 user nova-compute[74870]: iSNS:
Nov 28 06:41:05 user nova-compute[74870]: No targets found.
Nov 28 06:41:05 user nova-compute[74870]: STATIC:
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c
Nov 28 06:41:05 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:05 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:05 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:05 user nova-compute[74870]: No targets found.
Nov 28 06:41:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:05 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:05 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[126283e5-d97a-4fba-8d43-df7f7baebe9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde8fc56-1d36-4c83-bd1e-3cbd49b1f720]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7bf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11'): ({'sdh'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Removing single pathed devices sdh {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c971a30-750c-4889-bd24-40937be96a8e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab409b-2587-4bb4-846d-aed8ba4ed7a4]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Flushing IO for device /dev/sdh {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0bb7e7-49f5-4ab8-80b8-32f8fd7f7136]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d9b54-4d61-49c3-969f-47ceeb73a793]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] SCSI volumes sdh have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac43a14-4768-4622-b8b7-6a1f9f8cbd26]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb750e47-1755-48bf-b2fc-2e6a98fa3efe]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]
Nov 28 06:41:05 user nova-compute[74870]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a55dbd1-d606-4276-995f-c11bf86e5089]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] <== disconnect_volume: return (330ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPFSgHDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '66c94c69-4907-404d-ad02-d8ba2716a4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a60faa57-ed99-4b91-933b-a8f84da07af0', 'serial'} {{(pid=74870) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 06:41:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] swap_volume: removing Cinder connection for volume d6b27c97-e46a-41e7-8096-86cbe43a8b11 {{(pid=74870) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 06:41:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] swap_volume: Updating volume d6b27c97-e46a-41e7-8096-86cbe43a8b11 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "RPFSgHDJ", "auth_password": "CfxKEUWTlBJctI", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "a60faa57-ed99-4b91-933b-a8f84da07af0"}, "status": "reserved", "instance": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "attached_at": "", "detached_at": "", "volume_id": "a60faa57-ed99-4b91-933b-a8f84da07af0", "serial": "a60faa57-ed99-4b91-933b-a8f84da07af0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a60faa57-ed99-4b91-933b-a8f84da07af0', 'no_device': None, 'attachment_id': '78add638-af44-4198-b2ab-c83b6513d86e'} {{(pid=74870) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 06:41:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.353s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:07 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 636fad3b-617f-4a65-8cf7-ef67fd68304b is timed out.
Nov 28 06:41:07 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Successfully detached device vdb from instance 636fad3b-617f-4a65-8cf7-ef67fd68304b from the live domain config.
Nov 28 06:41:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeJBnSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:07 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a077cfd-cba3-4e04-accc-730d56a63cc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:07 user nova-compute[74870]: No targets found.
Nov 28 06:41:07 user nova-compute[74870]: iSNS:
Nov 28 06:41:07 user nova-compute[74870]: No targets found.
Nov 28 06:41:07 user nova-compute[74870]: STATIC:
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c
Nov 28 06:41:07 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:07 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:07 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:07 user nova-compute[74870]: No targets found.
Nov 28 06:41:07 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:07 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:07 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2378e07-97e0-4c9d-b9c1-16da6d9f170e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa09ff-905a-4b48-ad9b-1b6620085fe0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:07 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef4140430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685'): ({'sdg'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Removing single pathed devices sdg {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccae19d-e598-42a2-b772-61e53eb00dba]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35c0b6-81de-456d-b6e5-c5a59d6304b4]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flushing IO for device /dev/sdg {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e1a949-2f21-4a51-a881-d34306642019]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.174s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[021070a1-588b-45f5-9486-41d0ab93cfe3]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[959cf237-cbac-4b8d-b251-8f29311e3ce3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[439e50d1-ff1c-4bdd-afd7-745e8097dc79]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260]
Nov 28 06:41:07 user nova-compute[74870]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:07 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG os_brick.utils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16394af7-ba0c-4037-8bbf-dad44e87b1d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a7285f6-0c7b-4de0-a44d-fc22c9226685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4855f-35d9-45d8-9814-1a770f1116e8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] <== disconnect_volume: return (490ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1bf13c-d8c5-414b-a537-3c68ac27474d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a25ee28-49fd-4c68-8821-6d16500f2b33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae8eda-fa22-45ea-af82-c5eaa4f83b5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:41:08 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:41:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f15792-62b8-4367-921d-d8e4be410113]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG os_brick.utils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:08 user nova-compute[74870]: INFO nova.compute.manager [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Swapping volume a60faa57-ed99-4b91-933b-a8f84da07af0 for d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:41:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:08 user nova-compute[74870]: DEBUG nova.objects.instance [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'flavor' on Instance uuid 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.115s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-changed-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing instance network info cache due to event network-changed-1c17febf-a6ee-4954-9d0c-f6282ae774ea. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Acquiring lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Acquired lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Refreshing network info cache for port 1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updated VIF entry in instance network info cache for port 1c17febf-a6ee-4954-9d0c-f6282ae774ea. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Releasing lock "refresh_cache-04d6da52-74d4-4a87-b8b8-f5349354d8ee" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:41:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:14 user nova-compute[74870]: INFO nova.compute.manager [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Terminating instance
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Instance destroyed successfully.
Nov 28 06:41:15 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lazy-loading 'resources' on Instance uuid 04d6da52-74d4-4a87-b8b8-f5349354d8ee {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c17febf-a6, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77f7d25e-9068-4186-91d0-1c715717ee6c) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:47:ee,bridge_name='br-int',has_traffic_filtering=True,id=1c17febf-a6ee-4954-9d0c-f6282ae774ea,network=Network(27390ae5-3a4f-49b4-8aa8-de6a4b292636),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c17febf-a6')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1021f35-3b, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=241bf04e-d20c-4746-aeaf-a219d142d365) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=b1021f35-3b88-4288-818c-325753086daf,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1021f35-3b')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf5914b8-06, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b30fc86b-ecb1-4882-bc3a-d03d6c9e560d) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b0:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf5914b8-0656-47c2-ba2c-2fe6d04a6a65,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf5914b8-06')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7a63db6-53, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b3cb5a8-f2ed-4ac0-81ea-f7c917cd3836) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:e9:1e,bridge_name='br-int',has_traffic_filtering=True,id=a7a63db6-53d0-4e2f-acad-d649701a3f90,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7a63db6-53')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "address": "fa:16:3e:e9:f3:24", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c7e28d-01", "ovs_interfaceid": "97c7e28d-01ae-4b01-8594-2e507f37eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97c7e28d-01, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3d729c4-4641-48de-bb41-01dc969dc95b) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f3:24,bridge_name='br-int',has_traffic_filtering=True,id=97c7e28d-01ae-4b01-8594-2e507f37eeb7,network=Network(6c88a186-bf0b-411c-9931-49526e390fc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c7e28d-01')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e4ed8f6-1a, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ebd1810-9847-4aa5-a2df-00192cf77a84) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4ed8f6-1a')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1923245599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1923245599',id=12,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ==',key_name='tempest-keypair-1304188480',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49de64e4ec95433297cb192cadd60402',ramdisk_id='',reservation_id='r-0ie8vilt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-809434738',owner_user_name='tempest-TaggedBootDevicesTest-809434738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58a9aacbcb174f658f3cbba2e84d6e5b',uuid=04d6da52-74d4-4a87-b8b8-f5349354d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converting VIF {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6192ac90-a8, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eec4a95d-aab6-4bb1-b0a1-72e17d270e3d) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:16 user nova-compute[74870]: INFO os_vif [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a9:cc,bridge_name='br-int',has_traffic_filtering=True,id=6192ac90-a8ff-46d9-914f-ab6894136423,network=Network(b1cad690-a1fd-44ad-9289-98a4516b4fe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6192ac90-a8')
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqnLwyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14389e-0a58-416d-b5fb-33ccbb9066a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:16 user nova-compute[74870]: No targets found.
Nov 28 06:41:16 user nova-compute[74870]: iSNS:
Nov 28 06:41:16 user nova-compute[74870]: No targets found.
Nov 28 06:41:16 user nova-compute[74870]: STATIC:
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:16 user nova-compute[74870]: No targets found.
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:16 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:16 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fddf4b9-2336-4b00-8eb3-12560e24d42b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4323c6-7edd-4a10-b809-fd83b56c4e30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef42f7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349'): ({'sdd'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Removing single pathed devices sdd {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1607d7e7-caa1-48e7-88ec-b7b6133b4729]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e0ac6-91df-45d5-9a84-635b761dca89]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flushing IO for device /dev/sdd {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e54dc7-c52d-43ee-b8e2-9ee87b584c45]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance with vm_state active and task_state deleting.
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-b1021f35-3b88-4288-818c-325753086daf for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-b1021f35-3b88-4288-818c-325753086daf for instance with vm_state active and task_state deleting.
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING nova.compute.manager [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance with vm_state active and task_state deleting.
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4ced9-7aef-4ddb-a933-8b0d53708b41]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b72e4d-048e-4345-b5ce-13986aa33483]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[094f5336-3fca-4a35-be99-265ea835f25d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260]
Nov 28 06:41:16 user nova-compute[74870]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d001b09-312c-44d4-a06d-03d7e311f349 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f3c0b-940b-4d59-a122-c2bf77766072]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== disconnect_volume: return (330ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpjCbMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance with vm_state active and task_state deleting.
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:16 user nova-compute[74870]: WARNING nova.compute.manager [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance with vm_state active and task_state deleting.
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b2589b-6896-425e-a914-903f91b0d9b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:16 user nova-compute[74870]: No targets found.
Nov 28 06:41:16 user nova-compute[74870]: iSNS:
Nov 28 06:41:16 user nova-compute[74870]: No targets found.
Nov 28 06:41:16 user nova-compute[74870]: STATIC:
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c
Nov 28 06:41:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:16 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:16 user nova-compute[74870]: No targets found.
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:16 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:16 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c706b-37b7-4d13-89f2-dc81cc36b806]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f381ad-3642-4c22-b0e0-a8f786b12b35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc2d8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee085c-b1c7-4fac-b0d3-4b993a573330]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b6c77-6b99-4351-a374-41ea55e77984]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26345679-e5eb-4ce9-b3e8-60d46a9fa08f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7413be36-77e4-4a4c-9824-afb1bb639eed]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1b2862-e1fd-4aee-ab9b-c10b6a96e63d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:17 user nova-compute[74870]: WARNING nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance with vm_state active and task_state deleting.
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-unplugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-unplugged-6192ac90-a8ff-46d9-914f-ab6894136423 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Acquiring lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] No waiting events found dispatching network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:17 user nova-compute[74870]: WARNING nova.compute.manager [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received unexpected event network-vif-plugged-6192ac90-a8ff-46d9-914f-ab6894136423 for instance with vm_state active and task_state deleting.
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3665638-68c9-4c2d-b4a1-d483fa521574]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260]
Nov 28 06:41:17 user nova-compute[74870]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e601d555-836c-4a82-b7fe-db2c6dbf22ef]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== disconnect_volume: return (315ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suoqTAfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:17 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d9ca9f-5c79-453a-a252-6a67d69417e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:17 user nova-compute[74870]: No targets found.
Nov 28 06:41:17 user nova-compute[74870]: iSNS:
Nov 28 06:41:17 user nova-compute[74870]: No targets found.
Nov 28 06:41:17 user nova-compute[74870]: STATIC:
Nov 28 06:41:17 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:17 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:17 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:17 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:17 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:17 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:17 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584
Nov 28 06:41:17 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:17 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:17 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:41:17 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:17 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:17 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:17 user nova-compute[74870]: No targets found.
Nov 28 06:41:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:17 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:17 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec7ce5e-156a-48b6-8f34-afd9e472c5a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b9134-f0b6-4c1d-9607-6f680131f95d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc2d8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584'): ({'sde'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Removing single pathed devices sde {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[67755bb8-c736-4f78-92ef-a305e1513c5b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e042c-f26d-4e28-b368-d01f6cc6cfc3]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flushing IO for device /dev/sde {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7279df73-003f-45c4-9145-4d56f1bfad3b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab51892-5d13-4d22-a3f2-a4330bbeba79]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4159b7-32bc-4d12-b4db-d189ad8070b6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1bf5f-7b87-412d-a98b-4c87b27ef200]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260]
Nov 28 06:41:17 user nova-compute[74870]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfaded18-7989-4c10-bd0b-ab1878aed584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b8648-ddab-4433-a30e-d9bcaea3c58b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] <== disconnect_volume: return (302ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Deleting instance files /opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee_del
Nov 28 06:41:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Deletion of /opt/stack/data/nova/instances/04d6da52-74d4-4a87-b8b8-f5349354d8ee_del complete
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:41:17 user nova-compute[74870]: INFO nova.compute.manager [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Took 3.42 seconds to destroy the instance on the hypervisor.
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:41:17 user nova-compute[74870]: INFO nova.compute.claims [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Claim successful on node user
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66c94c69-4907-404d-ad02-d8ba2716a4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6b27c97-e46a-41e7-8096-86cbe43a8b11', 'serial': 'd6b27c97-e46a-41e7-8096-86cbe43a8b11'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPFSgHDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'a60faa57-ed99-4b91-933b-a8f84da07af0'}, 'status': 'reserved', 'instance': '66c94c69-4907-404d-ad02-d8ba2716a4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a60faa57-ed99-4b91-933b-a8f84da07af0', 'serial'} {{(pid=74870) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 06:41:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:18 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[37852cb9-956f-4367-b966-8032c2e8a90c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:41:18 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event volume-reimaged-1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Processing event volume-reimaged-1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.policy [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2037536-4255-489a-862a-6707c1966bfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: INFO nova.virt.block_device [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Booting with blank volume at /dev/vda
Nov 28 06:41:18 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3406c2b-4e6e-4be0-b84a-168c59322f00 is timed out.
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11] added
Nov 28 06:41:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Successfully detached device vdb from instance e3406c2b-4e6e-4be0-b84a-168c59322f00 from the live domain config.
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdnYrXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a863120a-8f1f-4122-83c5-8aa65b9b4388]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: INFO nova.virt.block_device [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Booting with volume 1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 at /dev/vda
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff79941a-2aeb-4494-b311-b61524bc1513]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbEUJYRq {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbEUJYRq" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac505b-13c4-4252-9b13-437ea1224f72]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DbEUJYRq'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f07bbe2-8943-4350-9553-09140dc26600]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.utils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb19f97-f887-43f6-91e7-ab6f67c3a7bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b3fe6e-f452-41e8-887c-79e5b3785d52]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0474ef-d3d4-446f-bd2d-afe0316b82b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca66d2d-c502-43ae-a52e-274186f8b4d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac17408-a502-4d64-b08a-8a1569fa3c7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb98e46-a177-4bff-a9d9-43ab2cd041d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]
Nov 28 06:41:18 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:41:18 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a42280-f09d-491d-8765-d38314fa0e47]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.utils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updating existing volume attachment record: 541d31ed-94fb-4336-be60-9d31e162b664 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8774152-d3ba-40f0-a801-c784d5739113]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13591ed-7e15-43e3-b279-a79982fc3cb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d85e3e-0095-40b2-b0ac-fd8df4d629b3]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:41:18 user nova-compute[74870]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Successfully created port: d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-deleted-97c7e28d-01ae-4b01-8594-2e507f37eeb7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:19 user nova-compute[74870]: INFO nova.compute.manager [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Neutron deleted interface 97c7e28d-01ae-4b01-8594-2e507f37eeb7; detaching it from the instance and deleting it from the info cache
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6192ac90-a8ff-46d9-914f-ab6894136423", "address": "fa:16:3e:2f:a9:cc", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6192ac90-a8", "ovs_interfaceid": "6192ac90-a8ff-46d9-914f-ab6894136423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Detach interface failed, port_id=97c7e28d-01ae-4b01-8594-2e507f37eeb7, reason: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Successfully updated port: d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-changed-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Refreshing instance network info cache due to event network-changed-d2fa54ed-54c8-4e8f-8009-95df2712735d. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Acquiring lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26161313438303434', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313438303434', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.312s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.objects.instance [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lazy-loading 'flavor' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ab565-a2f9-429b-be6a-275a6925b5ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:19 user nova-compute[74870]: No targets found.
Nov 28 06:41:19 user nova-compute[74870]: iSNS:
Nov 28 06:41:19 user nova-compute[74870]: No targets found.
Nov 28 06:41:19 user nova-compute[74870]: STATIC:
Nov 28 06:41:19 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:19 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:19 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:19 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:41:19 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:19 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:19 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:19 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:19 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:19 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1
Nov 28 06:41:19 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:19 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:19 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:19 user nova-compute[74870]: No targets found.
Nov 28 06:41:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:19 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:19 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39aef75-6d86-4615-bd34-bc3a69da6647]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25dd2dd-6876-4456-b5e4-c52ca9eb332a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 (non-flash)
Nov 28 06:41:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef413b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1'): ({'sdi'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Removing single pathed devices sdi {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac59cee-f47c-4585-93a0-f456e07725ae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39753275-2305-4edd-aaef-9f2f4dfc23fc]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Flushing IO for device /dev/sdi {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d87c2-00ff-4a91-84d7-f0d7d464d0fa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec3fb7-3e49-4275-84af-270e77c9164f]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] SCSI volumes sdi have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ac35f-e198-4937-bb1c-702e94459786]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating instance_info_cache with network_info: [{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16540c-f223-4af8-86f0-9841ef557450]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260]
Nov 28 06:41:19 user nova-compute[74870]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fda8b33-0c8d-40c2-b490-f03d7f7bcc76]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] <== disconnect_volume: return (1628ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance network_info: |[{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Acquired lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:41:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Refreshing network info cache for port d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:41:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:20 user nova-compute[74870]: DEBUG nova.network.neutron [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updated VIF entry in instance network info cache for port d2fa54ed-54c8-4e8f-8009-95df2712735d. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:41:20 user nova-compute[74870]: DEBUG nova.network.neutron [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating instance_info_cache with network_info: [{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Releasing lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:41:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 186646528 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.objects.instance [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lazy-loading 'flavor' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.452s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-deleted-6192ac90-a8ff-46d9-914f-ab6894136423 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:21 user nova-compute[74870]: INFO nova.compute.manager [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Neutron deleted interface 6192ac90-a8ff-46d9-914f-ab6894136423; detaching it from the instance and deleting it from the info cache
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "address": "fa:16:3e:71:e9:1e", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7a63db6-53", "ovs_interfaceid": "a7a63db6-53d0-4e2f-acad-d649701a3f90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 306184192 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Detach interface failed, port_id=6192ac90-a8ff-46d9-914f-ab6894136423, reason: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-deleted-a7a63db6-53d0-4e2f-acad-d649701a3f90 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:21 user nova-compute[74870]: INFO nova.compute.manager [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Neutron deleted interface a7a63db6-53d0-4e2f-acad-d649701a3f90; detaching it from the instance and deleting it from the info cache
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [{"id": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "address": "fa:16:3e:52:47:ee", "network": {"id": "27390ae5-3a4f-49b4-8aa8-de6a4b292636", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-116581290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c17febf-a6", "ovs_interfaceid": "1c17febf-a6ee-4954-9d0c-f6282ae774ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1021f35-3b88-4288-818c-325753086daf", "address": "fa:16:3e:08:b5:4a", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1021f35-3b", "ovs_interfaceid": "b1021f35-3b88-4288-818c-325753086daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "address": "fa:16:3e:e9:b0:8c", "network": {"id": "6c88a186-bf0b-411c-9931-49526e390fc8", "bridge": "br-int", "label": "tempest-device-tagging-net1-53824156", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5914b8-06", "ovs_interfaceid": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "address": "fa:16:3e:c3:3a:b8", "network": {"id": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "bridge": "br-int", "label": "tempest-device-tagging-net2-2132413377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49de64e4ec95433297cb192cadd60402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4ed8f6-1a", "ovs_interfaceid": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Detach interface failed, port_id=a7a63db6-53d0-4e2f-acad-d649701a3f90, reason: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:22 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Took 4.50 seconds to deallocate network for instance.
Nov 28 06:41:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 438304768 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 598736896 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:41:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Updating instance_info_cache with network_info: [{"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-deleted-1c17febf-a6ee-4954-9d0c-f6282ae774ea {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Received event network-vif-deleted-7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 900726784 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 1070596096 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPFSgHDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'a60faa57-ed99-4b91-933b-a8f84da07af0'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:25 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ea148-521f-4129-938e-2e2522af1535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:25 user nova-compute[74870]: No targets found.
Nov 28 06:41:25 user nova-compute[74870]: iSNS:
Nov 28 06:41:25 user nova-compute[74870]: No targets found.
Nov 28 06:41:25 user nova-compute[74870]: STATIC:
Nov 28 06:41:25 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:25 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:25 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:25 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:41:25 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:25 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:25 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0
Nov 28 06:41:25 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:25 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:25 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:25 user nova-compute[74870]: No targets found.
Nov 28 06:41:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:25 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:25 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9515b893-63be-43b4-a35c-8dab43aa9b7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf4367a-5c21-46e8-bfe0-f2816ad531d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:25 user nova-compute[74870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:25 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 (non-flash)
Nov 28 06:41:25 user nova-compute[74870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:25 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc4453f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51c414-9c82-4761-8ae0-7f0459b5a1d0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0700025-ceba-462e-9b22-1325e2d7bde4]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec4d5a2-3928-4e0a-a8b4-f402c864c0b3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a4bbff-198b-4277-8d27-99a326fd4e15]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef2ba48-7edb-4f95-8dd8-22f953ce8533]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: INFO nova.compute.manager [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Took 3.53 seconds to detach 3 volumes for instance.
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd4fbf-6f36-4640-a4f9-7ea5f085e5e7]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260]
Nov 28 06:41:25 user nova-compute[74870]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60faa57-ed99-4b91-933b-a8f84da07af0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd34f5-324a-490d-8dce-6e595a9d2c15]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] <== disconnect_volume: return (332ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '66c94c69-4907-404d-ad02-d8ba2716a4e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6b27c97-e46a-41e7-8096-86cbe43a8b11', 'serial'} {{(pid=74870) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] swap_volume: removing Cinder connection for volume a60faa57-ed99-4b91-933b-a8f84da07af0 {{(pid=74870) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.619s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:26 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Deleted allocations for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "04d6da52-74d4-4a87-b8b8-f5349354d8ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.365s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] swap_volume: Updating volume a60faa57-ed99-4b91-933b-a8f84da07af0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DbEUJYRq", "auth_password": "LNYWGSC0E3hamr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "d6b27c97-e46a-41e7-8096-86cbe43a8b11"}, "status": "reserved", "instance": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "attached_at": "", "detached_at": "", "volume_id": "d6b27c97-e46a-41e7-8096-86cbe43a8b11", "serial": "d6b27c97-e46a-41e7-8096-86cbe43a8b11"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd6b27c97-e46a-41e7-8096-86cbe43a8b11', 'no_device': None, 'attachment_id': 'c6ff30d2-71d0-4a84-984b-29c919264e8b'} {{(pid=74870) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.658s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:27 user nova-compute[74870]: INFO nova.compute.manager [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Detaching volume d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:27 user nova-compute[74870]: INFO nova.virt.block_device [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Attempting to driver detach volume d6b27c97-e46a-41e7-8096-86cbe43a8b11 from mountpoint /dev/vdb
Nov 28 06:41:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Attempting to detach device vdb from instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:41:27 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:41:27 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:41:27 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:41:27 user nova-compute[74870]:   <serial>d6b27c97-e46a-41e7-8096-86cbe43a8b11</serial>
Nov 28 06:41:27 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:41:27 user nova-compute[74870]: </disk>
Nov 28 06:41:27 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:41:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Successfully detached device vdb from instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 from the persistent domain config.
Nov 28 06:41:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:41:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:41:27 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:41:27 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:41:27 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:41:27 user nova-compute[74870]:   <serial>d6b27c97-e46a-41e7-8096-86cbe43a8b11</serial>
Nov 28 06:41:27 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:41:27 user nova-compute[74870]: </disk>
Nov 28 06:41:27 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:41:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Creating image(s)
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Ensure instance console log exists: /opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Start _get_guest_xml network_info=[{"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70280af1-c742-4096-9abc-7a1ca9b44079', 'attached_at': '', 'detached_at': '', 'volume_id': '1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'serial': '1d9c5b72-fcf3-422e-bee9-f2fffafb9d92'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '541d31ed-94fb-4336-be60-9d31e162b664', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:41:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 06:41:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lazy-loading 'vcpu_model' on Instance uuid 70280af1-c742-4096-9abc-7a1ca9b44079 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:28 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4cc262-cf24-42b1-800b-6784c27e4e29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:41:28 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7daabb4-b781-4c43-bc05-0a047fa79e6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92] added
Nov 28 06:41:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca6eaa4-e9a6-4560-a23a-03041fdea9a6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e205b56-cf2c-44da-b94f-3e779617159e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBFAvuXT {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBFAvuXT" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3730506-de9d-43a8-98d7-848074e6aaed]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBFAvuXT'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90de7482-72ff-4fbf-9d93-e28844bee6cc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[30863ec0-64ac-467f-971c-3eebb20a874b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79aaa3c-d00b-4d2e-adc5-45754dff4728]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]
Nov 28 06:41:29 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0010c910-628d-41d9-8e35-4297a54e67b3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0c07d-4a24-4733-9ab9-f5486e69a2dd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d3651-c8b2-44ea-80db-be81a06aa1fb]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.utils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba172e41-8466-4dfd-a81c-bd3a79eb2a0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5b700-5753-4887-90e1-d35f7a2cbb08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108e584-e105-4684-be83-d0ce41ba7f57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce255905-3706-4d73-aeef-514b688f3e7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:41:29 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6264f2be-3872-4f78-a48c-218db6d7d323]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG os_brick.utils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating existing volume attachment record: 99a027cd-a110-43cb-98d8-a7bedce912ed {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:29 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:41:29 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:41:29 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=6633MB free_disk=25.492809295654297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance b30131e3-a805-4fbc-815c-7e379c44a386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance b4802806-6422-46da-8d0f-5674af0a8433 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 317be079-9b77-4139-88a4-36efb848c025 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e3406c2b-4e6e-4be0-b84a-168c59322f00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 70280af1-c742-4096-9abc-7a1ca9b44079 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23934653139386434', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653139386434', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1780739755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1245407202',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg==',key_name='tempest-keypair-885228878',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff4ac048770a4680a35f71465d191d49',ramdisk_id='',reservation_id='r-l9wr9xfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-960022347',owner_user_name='tempest-ServerActionsV293TestJSON-960022347-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48e7c51916684bec98970a963f2c560e',uuid=70280af1-c742-4096-9abc-7a1ca9b44079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converting VIF {"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:41:30 user nova-compute[74870]:   <uuid>70280af1-c742-4096-9abc-7a1ca9b44079</uuid>
Nov 28 06:41:30 user nova-compute[74870]:   <name>instance-0000000b</name>
Nov 28 06:41:30 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:41:30 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:41:30 user nova-compute[74870]:   <metadata>
Nov 28 06:41:30 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:41:30 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:41:30 user nova-compute[74870]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1780739755</nova:name>
Nov 28 06:41:30 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:41:28</nova:creationTime>
Nov 28 06:41:30 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:41:30 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:41:30 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:41:30 user nova-compute[74870]:       <nova:owner>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:user uuid="48e7c51916684bec98970a963f2c560e">tempest-ServerActionsV293TestJSON-960022347-project-member</nova:user>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:project uuid="ff4ac048770a4680a35f71465d191d49">tempest-ServerActionsV293TestJSON-960022347</nova:project>
Nov 28 06:41:30 user nova-compute[74870]:       </nova:owner>
Nov 28 06:41:30 user nova-compute[74870]:       <nova:ports>
Nov 28 06:41:30 user nova-compute[74870]:         <nova:port uuid="e8244d47-16b3-4035-8877-b5d7b137dea6">
Nov 28 06:41:30 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 06:41:30 user nova-compute[74870]:         </nova:port>
Nov 28 06:41:30 user nova-compute[74870]:       </nova:ports>
Nov 28 06:41:30 user nova-compute[74870]:     </nova:instance>
Nov 28 06:41:30 user nova-compute[74870]:   </metadata>
Nov 28 06:41:30 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:41:30 user nova-compute[74870]:     <system>
Nov 28 06:41:30 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:41:30 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:41:30 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:41:30 user nova-compute[74870]:       <entry name="serial">70280af1-c742-4096-9abc-7a1ca9b44079</entry>
Nov 28 06:41:30 user nova-compute[74870]:       <entry name="uuid">70280af1-c742-4096-9abc-7a1ca9b44079</entry>
Nov 28 06:41:30 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:41:30 user nova-compute[74870]:     </system>
Nov 28 06:41:30 user nova-compute[74870]:   </sysinfo>
Nov 28 06:41:30 user nova-compute[74870]:   <os>
Nov 28 06:41:30 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:41:30 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:41:30 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:41:30 user nova-compute[74870]:   </os>
Nov 28 06:41:30 user nova-compute[74870]:   <features>
Nov 28 06:41:30 user nova-compute[74870]:     <acpi/>
Nov 28 06:41:30 user nova-compute[74870]:     <apic/>
Nov 28 06:41:30 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:41:30 user nova-compute[74870]:   </features>
Nov 28 06:41:30 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:41:30 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:41:30 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:41:30 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:41:30 user nova-compute[74870]:   </clock>
Nov 28 06:41:30 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:41:30 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:41:30 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:41:30 user nova-compute[74870]:   </cpu>
Nov 28 06:41:30 user nova-compute[74870]:   <devices>
Nov 28 06:41:30 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:41:30 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:41:30 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 06:41:30 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:41:30 user nova-compute[74870]:       <serial>1d9c5b72-fcf3-422e-bee9-f2fffafb9d92</serial>
Nov 28 06:41:30 user nova-compute[74870]:     </disk>
Nov 28 06:41:30 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:41:30 user nova-compute[74870]:       <mac address="fa:16:3e:4b:80:9f"/>
Nov 28 06:41:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:41:30 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:41:30 user nova-compute[74870]:       <target dev="tape8244d47-16"/>
Nov 28 06:41:30 user nova-compute[74870]:     </interface>
Nov 28 06:41:30 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:41:30 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079/console.log" append="off"/>
Nov 28 06:41:30 user nova-compute[74870]:     </serial>
Nov 28 06:41:30 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:41:30 user nova-compute[74870]:     <video>
Nov 28 06:41:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:41:30 user nova-compute[74870]:     </video>
Nov 28 06:41:30 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:41:30 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:41:30 user nova-compute[74870]:     </rng>
Nov 28 06:41:30 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:41:30 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:41:30 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:41:30 user nova-compute[74870]:     </memballoon>
Nov 28 06:41:30 user nova-compute[74870]:   </devices>
Nov 28 06:41:30 user nova-compute[74870]: </domain>
Nov 28 06:41:30 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1780739755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1245407202',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg==',key_name='tempest-keypair-885228878',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff4ac048770a4680a35f71465d191d49',ramdisk_id='',reservation_id='r-l9wr9xfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-960022347',owner_user_name='tempest-ServerActionsV293TestJSON-960022347-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48e7c51916684bec98970a963f2c560e',uuid=70280af1-c742-4096-9abc-7a1ca9b44079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converting VIF {"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG os_vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '594ba5be-afcf-598f-b8bc-1ab310572892', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8244d47-16, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8244d47-16, col_values=(('qos', UUID('8a01246d-1058-4218-8f7f-7f7c325be1f4')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8244d47-16, col_values=(('external_ids', {'iface-id': 'e8244d47-16b3-4035-8877-b5d7b137dea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:80:9f', 'vm-uuid': '70280af1-c742-4096-9abc-7a1ca9b44079'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:30 user nova-compute[74870]: INFO os_vif [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16')
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] No VIF found with MAC fa:16:3e:4b:80:9f, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:41:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:31 user nova-compute[74870]: WARNING nova.compute.manager [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 06:41:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:41:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance spawned successfully.
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74870) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:33 user nova-compute[74870]: WARNING nova.compute.manager [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state active and task_state None.
Nov 28 06:41:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:41:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Creating image(s)
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Ensure instance console log exists: /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Start _get_guest_xml network_info=[{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eea1149f-7553-4beb-b8df-87822bd3abd5', 'attached_at': '', 'detached_at': '', 'volume_id': '3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'serial': '3d2e80c8-217c-4493-967b-ecae0b6fe4e1'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '99a027cd-a110-43cb-98d8-a7bedce912ed', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:41:36 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:41:36 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:36 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:36 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:36 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebd6ba8-6756-4e1f-b041-ec130671c693]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:41:36 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e28c58a-bf5d-4a63-ab7b-b5ab46b2589c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1] added
Nov 28 06:41:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6991313-a2bf-4f99-8101-506b5afdec7c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc2fb5-071e-4fdc-8c9c-00b506d1be20]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMnUjhmx {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMnUjhmx" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b938697-9b54-46ad-a16f-1ca5439cfe7c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMnUjhmx'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652bebb-4d3b-4b54-b24d-ab812cf77cc1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e2164-25d0-4f47-bd85-1d83fe9c23a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[76393fc3-aab6-467e-8896-96b861b50a25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260]
Nov 28 06:41:36 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff08e62-1176-4e77-aef6-d994530047b7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97945148-2ce3-4d6a-96e4-4e9387b34bb7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8698da-b962-4b40-8970-e7c6c56aa74a]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26434363231306537', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434363231306537', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1924475466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1924475466',id=16,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-r9228def',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:18Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=eea1149f-7553-4beb-b8df-87822bd3abd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'pci_devices' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:41:37 user nova-compute[74870]:   <uuid>eea1149f-7553-4beb-b8df-87822bd3abd5</uuid>
Nov 28 06:41:37 user nova-compute[74870]:   <name>instance-00000010</name>
Nov 28 06:41:37 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:41:37 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:41:37 user nova-compute[74870]:   <metadata>
Nov 28 06:41:37 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:41:37 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:41:37 user nova-compute[74870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1924475466</nova:name>
Nov 28 06:41:37 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:41:36</nova:creationTime>
Nov 28 06:41:37 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:41:37 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:41:37 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:41:37 user nova-compute[74870]:       <nova:owner>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:user uuid="c13b793a926942e88fc3416cf3fa005e">tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member</nova:user>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:project uuid="a07e9312175c4e73aa29a51865d61ebd">tempest-ServerBootFromVolumeStableRescueTest-397751332</nova:project>
Nov 28 06:41:37 user nova-compute[74870]:       </nova:owner>
Nov 28 06:41:37 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:41:37 user nova-compute[74870]:       <nova:ports>
Nov 28 06:41:37 user nova-compute[74870]:         <nova:port uuid="d2fa54ed-54c8-4e8f-8009-95df2712735d">
Nov 28 06:41:37 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 06:41:37 user nova-compute[74870]:         </nova:port>
Nov 28 06:41:37 user nova-compute[74870]:       </nova:ports>
Nov 28 06:41:37 user nova-compute[74870]:     </nova:instance>
Nov 28 06:41:37 user nova-compute[74870]:   </metadata>
Nov 28 06:41:37 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:41:37 user nova-compute[74870]:     <system>
Nov 28 06:41:37 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:41:37 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:41:37 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:41:37 user nova-compute[74870]:       <entry name="serial">eea1149f-7553-4beb-b8df-87822bd3abd5</entry>
Nov 28 06:41:37 user nova-compute[74870]:       <entry name="uuid">eea1149f-7553-4beb-b8df-87822bd3abd5</entry>
Nov 28 06:41:37 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:41:37 user nova-compute[74870]:     </system>
Nov 28 06:41:37 user nova-compute[74870]:   </sysinfo>
Nov 28 06:41:37 user nova-compute[74870]:   <os>
Nov 28 06:41:37 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:41:37 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:41:37 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:41:37 user nova-compute[74870]:   </os>
Nov 28 06:41:37 user nova-compute[74870]:   <features>
Nov 28 06:41:37 user nova-compute[74870]:     <acpi/>
Nov 28 06:41:37 user nova-compute[74870]:     <apic/>
Nov 28 06:41:37 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:41:37 user nova-compute[74870]:   </features>
Nov 28 06:41:37 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:41:37 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:41:37 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:41:37 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:41:37 user nova-compute[74870]:   </clock>
Nov 28 06:41:37 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:41:37 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:41:37 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:41:37 user nova-compute[74870]:   </cpu>
Nov 28 06:41:37 user nova-compute[74870]:   <devices>
Nov 28 06:41:37 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:41:37 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:41:37 user nova-compute[74870]:       <source dev="/dev/sdd"/>
Nov 28 06:41:37 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:41:37 user nova-compute[74870]:       <serial>3d2e80c8-217c-4493-967b-ecae0b6fe4e1</serial>
Nov 28 06:41:37 user nova-compute[74870]:     </disk>
Nov 28 06:41:37 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:41:37 user nova-compute[74870]:       <mac address="fa:16:3e:d5:81:50"/>
Nov 28 06:41:37 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:41:37 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:41:37 user nova-compute[74870]:       <target dev="tapd2fa54ed-54"/>
Nov 28 06:41:37 user nova-compute[74870]:     </interface>
Nov 28 06:41:37 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:41:37 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/console.log" append="off"/>
Nov 28 06:41:37 user nova-compute[74870]:     </serial>
Nov 28 06:41:37 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:41:37 user nova-compute[74870]:     <video>
Nov 28 06:41:37 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:41:37 user nova-compute[74870]:     </video>
Nov 28 06:41:37 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:41:37 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:41:37 user nova-compute[74870]:     </rng>
Nov 28 06:41:37 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:41:37 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:41:37 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:41:37 user nova-compute[74870]:     </memballoon>
Nov 28 06:41:37 user nova-compute[74870]:   </devices>
Nov 28 06:41:37 user nova-compute[74870]: </domain>
Nov 28 06:41:37 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1924475466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1924475466',id=16,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-r9228def',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:18Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=eea1149f-7553-4beb-b8df-87822bd3abd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG os_vif [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baaf1b3c-4c31-5cea-b9ca-2654e0d176b8', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2fa54ed-54, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2fa54ed-54, col_values=(('qos', UUID('41fb1953-5d9e-4b7a-a58d-4e59258bdbd4')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2fa54ed-54, col_values=(('external_ids', {'iface-id': 'd2fa54ed-54c8-4e8f-8009-95df2712735d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:81:50', 'vm-uuid': 'eea1149f-7553-4beb-b8df-87822bd3abd5'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:37 user nova-compute[74870]: INFO os_vif [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54')
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No VIF found with MAC fa:16:3e:d5:81:50, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:41:38 user nova-compute[74870]: INFO nova.compute.claims [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Claim successful on node user
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:41:38 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:41:38 user nova-compute[74870]: DEBUG nova.policy [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:41:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Creating image(s)
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "/opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "/opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "/opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.246s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk 1073741824" returned: 0 in 0.289s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.540s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Successfully created port: 1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:39 user nova-compute[74870]: WARNING nova.compute.manager [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state building and task_state spawning.
Nov 28 06:41:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:41:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Cannot resize image /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Ensure instance console log exists: /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Successfully updated port: 1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "refresh_cache-93f30c00-ea3c-445c-b0c9-5ef899412580" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquired lock "refresh_cache-93f30c00-ea3c-445c-b0c9-5ef899412580" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Updating instance_info_cache with network_info: [{"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Releasing lock "refresh_cache-93f30c00-ea3c-445c-b0c9-5ef899412580" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Instance network_info: |[{"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Start _get_guest_xml network_info=[{"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:41:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:41:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-759299404',display_name='tempest-VolumesAdminNegativeTest-server-759299404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-759299404',id=17,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c265a98d205f4b679d3a810b4745691a',ramdisk_id='',reservation_id='r-e47aurbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1747870246',owner_user_name='tempest-VolumesAdminNegativeTest-1747870246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:39Z,user_data=None,user_id='3e8b23eae758490a8a2476797479f208',uuid=93f30c00-ea3c-445c-b0c9-5ef899412580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converting VIF {"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'pci_devices' on Instance uuid 93f30c00-ea3c-445c-b0c9-5ef899412580 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:41:40 user nova-compute[74870]:   <uuid>93f30c00-ea3c-445c-b0c9-5ef899412580</uuid>
Nov 28 06:41:40 user nova-compute[74870]:   <name>instance-00000011</name>
Nov 28 06:41:40 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:41:40 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:41:40 user nova-compute[74870]:   <metadata>
Nov 28 06:41:40 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:41:40 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:41:40 user nova-compute[74870]:       <nova:name>tempest-VolumesAdminNegativeTest-server-759299404</nova:name>
Nov 28 06:41:40 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:41:40</nova:creationTime>
Nov 28 06:41:40 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:41:40 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:41:40 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:41:40 user nova-compute[74870]:       <nova:owner>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:user uuid="3e8b23eae758490a8a2476797479f208">tempest-VolumesAdminNegativeTest-1747870246-project-member</nova:user>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:project uuid="c265a98d205f4b679d3a810b4745691a">tempest-VolumesAdminNegativeTest-1747870246</nova:project>
Nov 28 06:41:40 user nova-compute[74870]:       </nova:owner>
Nov 28 06:41:40 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:41:40 user nova-compute[74870]:       <nova:ports>
Nov 28 06:41:40 user nova-compute[74870]:         <nova:port uuid="1cc3fcfe-307b-49f6-bb59-b8b33aa7764a">
Nov 28 06:41:40 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 06:41:40 user nova-compute[74870]:         </nova:port>
Nov 28 06:41:40 user nova-compute[74870]:       </nova:ports>
Nov 28 06:41:40 user nova-compute[74870]:     </nova:instance>
Nov 28 06:41:40 user nova-compute[74870]:   </metadata>
Nov 28 06:41:40 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:41:40 user nova-compute[74870]:     <system>
Nov 28 06:41:40 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:41:40 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:41:40 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:41:40 user nova-compute[74870]:       <entry name="serial">93f30c00-ea3c-445c-b0c9-5ef899412580</entry>
Nov 28 06:41:40 user nova-compute[74870]:       <entry name="uuid">93f30c00-ea3c-445c-b0c9-5ef899412580</entry>
Nov 28 06:41:40 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:41:40 user nova-compute[74870]:     </system>
Nov 28 06:41:40 user nova-compute[74870]:   </sysinfo>
Nov 28 06:41:40 user nova-compute[74870]:   <os>
Nov 28 06:41:40 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:41:40 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:41:40 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:41:40 user nova-compute[74870]:   </os>
Nov 28 06:41:40 user nova-compute[74870]:   <features>
Nov 28 06:41:40 user nova-compute[74870]:     <acpi/>
Nov 28 06:41:40 user nova-compute[74870]:     <apic/>
Nov 28 06:41:40 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:41:40 user nova-compute[74870]:   </features>
Nov 28 06:41:40 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:41:40 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:41:40 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:41:40 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:41:40 user nova-compute[74870]:   </clock>
Nov 28 06:41:40 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:41:40 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:41:40 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:41:40 user nova-compute[74870]:   </cpu>
Nov 28 06:41:40 user nova-compute[74870]:   <devices>
Nov 28 06:41:40 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:41:40 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:41:40 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk"/>
Nov 28 06:41:40 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:41:40 user nova-compute[74870]:     </disk>
Nov 28 06:41:40 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:41:40 user nova-compute[74870]:       <mac address="fa:16:3e:f1:e8:11"/>
Nov 28 06:41:40 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:41:40 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:41:40 user nova-compute[74870]:       <target dev="tap1cc3fcfe-30"/>
Nov 28 06:41:40 user nova-compute[74870]:     </interface>
Nov 28 06:41:40 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:41:40 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/console.log" append="off"/>
Nov 28 06:41:40 user nova-compute[74870]:     </serial>
Nov 28 06:41:40 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:41:40 user nova-compute[74870]:     <video>
Nov 28 06:41:40 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:41:40 user nova-compute[74870]:     </video>
Nov 28 06:41:40 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:41:40 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:41:40 user nova-compute[74870]:     </rng>
Nov 28 06:41:40 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:41:40 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:41:40 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:41:40 user nova-compute[74870]:     </memballoon>
Nov 28 06:41:40 user nova-compute[74870]:   </devices>
Nov 28 06:41:40 user nova-compute[74870]: </domain>
Nov 28 06:41:40 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-759299404',display_name='tempest-VolumesAdminNegativeTest-server-759299404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-759299404',id=17,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c265a98d205f4b679d3a810b4745691a',ramdisk_id='',reservation_id='r-e47aurbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1747870246',owner_user_name='tempest-VolumesAdminNegativeTest-1747870246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:39Z,user_data=None,user_id='3e8b23eae758490a8a2476797479f208',uuid=93f30c00-ea3c-445c-b0c9-5ef899412580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converting VIF {"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG os_vif [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41ddeb24-be9a-56c1-827b-0eafacef07b7', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cc3fcfe-30, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cc3fcfe-30, col_values=(('qos', UUID('ae1fd479-c5ed-4e8b-9a7f-1a46d1d02876')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cc3fcfe-30, col_values=(('external_ids', {'iface-id': '1cc3fcfe-307b-49f6-bb59-b8b33aa7764a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:e8:11', 'vm-uuid': '93f30c00-ea3c-445c-b0c9-5ef899412580'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:41 user nova-compute[74870]: INFO os_vif [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30')
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] No VIF found with MAC fa:16:3e:f1:e8:11, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:41:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance spawned successfully.
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:41 user nova-compute[74870]: WARNING nova.compute.manager [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state building and task_state spawning.
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-changed-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Refreshing instance network info cache due to event network-changed-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Acquiring lock "refresh_cache-93f30c00-ea3c-445c-b0c9-5ef899412580" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Acquired lock "refresh_cache-93f30c00-ea3c-445c-b0c9-5ef899412580" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Refreshing network info cache for port 1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:41:41 user nova-compute[74870]: INFO nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 28 06:41:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:41:42 user nova-compute[74870]: INFO nova.compute.manager [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Took 24.49 seconds to build instance.
Nov 28 06:41:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.579s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Updated VIF entry in instance network info cache for port 1cc3fcfe-307b-49f6-bb59-b8b33aa7764a. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Updating instance_info_cache with network_info: [{"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Releasing lock "refresh_cache-93f30c00-ea3c-445c-b0c9-5ef899412580" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] No waiting events found dispatching network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:43 user nova-compute[74870]: WARNING nova.compute.manager [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received unexpected event network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance with vm_state building and task_state spawning.
Nov 28 06:41:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] No waiting events found dispatching network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:43 user nova-compute[74870]: WARNING nova.compute.manager [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received unexpected event network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance with vm_state building and task_state spawning.
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:41:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Instance spawned successfully.
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:41:44 user nova-compute[74870]: INFO nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 28 06:41:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:41:44 user nova-compute[74870]: INFO nova.compute.manager [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Took 6.60 seconds to build instance.
Nov 28 06:41:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.687s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 is timed out.
Nov 28 06:41:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Successfully detached device vdb from instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 from the live domain config.
Nov 28 06:41:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbEUJYRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'd6b27c97-e46a-41e7-8096-86cbe43a8b11'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:41:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[411c137a-cb17-4048-aefc-50263b860058]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:41:48 user nova-compute[74870]: No targets found.
Nov 28 06:41:48 user nova-compute[74870]: iSNS:
Nov 28 06:41:48 user nova-compute[74870]: No targets found.
Nov 28 06:41:48 user nova-compute[74870]: STATIC:
Nov 28 06:41:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:41:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11
Nov 28 06:41:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92
Nov 28 06:41:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:41:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:41:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:41:48 user nova-compute[74870]: FIRMWARE:
Nov 28 06:41:48 user nova-compute[74870]: No targets found.
Nov 28 06:41:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:41:48 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:41:48 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc5063-0f7e-4414-b9b9-59521e95f4e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7929ae8-c121-4ab7-ac0c-a1556496faf5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:41:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef413ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82524a3f-81a7-4ada-a7b1-1fff573a4a9d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec41d448-dd8d-4333-9096-78c0df5edbc0]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab79c468-6b93-4443-b6bf-3aecb396df26]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84bbff6-ff47-42cb-9204-3c80510a457d]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662e236-c07d-4d26-90f5-68e012419647]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed39fb98-8d19-4f87-9277-1bc88439e612]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260]
Nov 28 06:41:48 user nova-compute[74870]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11, portal: 172.16.0.220,3260] successful.
Nov 28 06:41:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b27c97-e46a-41e7-8096-86cbe43a8b11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a1324-3f31-40df-977d-19a098df418f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] <== disconnect_volume: return (359ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:41:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:41:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lazy-loading 'flavor' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:52 user nova-compute[74870]: INFO nova.compute.manager [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Terminating instance
Nov 28 06:41:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-vif-unplugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] No waiting events found dispatching network-vif-unplugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-vif-unplugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:41:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Instance destroyed successfully.
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.objects.instance [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lazy-loading 'resources' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2057452123',display_name='tempest-VolumesAssistedSnapshotsTest-server-2057452123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2057452123',id=10,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlsgIHBkjqeXLgCZOFjOk2R3rFX+Exf4pm9jd/j6HnEa74ku0fNjIAuyGrYRiG220+GjsvdmFmAGshilmUdIU2Uzk7IAbyaHHmjO0U8FLqIFGGoaUXURCrhv/WaOkKAsw==',key_name='tempest-keypair-1012101206',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f8c916eb72b4f5cb1b3fa97845e2072',ramdisk_id='',reservation_id='r-hti819ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-736418019',owner_user_name='tempest-VolumesAssistedSnapshotsTest-736418019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f854afd1c504c7ba7eea6643d7bc7c9',uuid=e3406c2b-4e6e-4be0-b84a-168c59322f00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Converting VIF {"id": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "address": "fa:16:3e:e9:e0:dc", "network": {"id": "ef315ae7-1984-498d-9a2d-19fe658a6019", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5004235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f8c916eb72b4f5cb1b3fa97845e2072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cb2e46-5e", "ovs_interfaceid": "44cb2e46-5eae-4728-ac61-29177ecb06f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG os_vif [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44cb2e46-5e, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fb8f810-353a-4788-b7d3-f8ea4ea7e89f) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:53 user nova-compute[74870]: INFO os_vif [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e0:dc,bridge_name='br-int',has_traffic_filtering=True,id=44cb2e46-5eae-4728-ac61-29177ecb06f6,network=Network(ef315ae7-1984-498d-9a2d-19fe658a6019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44cb2e46-5e')
Nov 28 06:41:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Deleting instance files /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00_del
Nov 28 06:41:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Deletion of /opt/stack/data/nova/instances/e3406c2b-4e6e-4be0-b84a-168c59322f00_del complete
Nov 28 06:41:53 user nova-compute[74870]: INFO nova.compute.manager [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 06:41:53 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:41:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:54 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:54 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Took 0.83 seconds to deallocate network for instance.
Nov 28 06:41:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:54 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:41:54 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:41:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:54 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Deleted allocations for instance e3406c2b-4e6e-4be0-b84a-168c59322f00
Nov 28 06:41:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Acquiring lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Lock "e3406c2b-4e6e-4be0-b84a-168c59322f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] No waiting events found dispatching network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:55 user nova-compute[74870]: WARNING nova.compute.manager [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received unexpected event network-vif-plugged-44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance with vm_state deleted and task_state None.
Nov 28 06:41:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Received event network-vif-deleted-44cb2e46-5eae-4728-ac61-29177ecb06f6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "317be079-9b77-4139-88a4-36efb848c025" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "317be079-9b77-4139-88a4-36efb848c025-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "317be079-9b77-4139-88a4-36efb848c025-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:56 user nova-compute[74870]: INFO nova.compute.manager [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Terminating instance
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 317be079-9b77-4139-88a4-36efb848c025] Instance destroyed successfully.
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lazy-loading 'resources' on Instance uuid 317be079-9b77-4139-88a4-36efb848c025 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1921302970',display_name='tempest-ServersNegativeTestJSON-server-1921302970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1921302970',id=13,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6362608255de47c3afa716e3091af3d0',ramdisk_id='',reservation_id='r-k2hszewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1666481027',owner_user_name='tempest-ServersNegativeTestJSON-1666481027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:14Z,user_data=None,user_id='5bd89a43a3bf4952a40cd1dd07de2442',uuid=317be079-9b77-4139-88a4-36efb848c025,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converting VIF {"id": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "address": "fa:16:3e:4e:e8:97", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61814597-e5", "ovs_interfaceid": "61814597-e5ae-41b8-9cfb-2de8d8f596ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG os_vif [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61814597-e5, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b20056b4-0772-4162-a7e6-b99680eb7ddc) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:41:56 user nova-compute[74870]: INFO os_vif [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=61814597-e5ae-41b8-9cfb-2de8d8f596ef,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61814597-e5')
Nov 28 06:41:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Deleting instance files /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025_del
Nov 28 06:41:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Deletion of /opt/stack/data/nova/instances/317be079-9b77-4139-88a4-36efb848c025_del complete
Nov 28 06:41:56 user nova-compute[74870]: INFO nova.compute.manager [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 06:41:56 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 317be079-9b77-4139-88a4-36efb848c025] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:41:56 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 317be079-9b77-4139-88a4-36efb848c025] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 317be079-9b77-4139-88a4-36efb848c025] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:41:57 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 317be079-9b77-4139-88a4-36efb848c025] Took 0.44 seconds to deallocate network for instance.
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received event network-vif-unplugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] No waiting events found dispatching network-vif-unplugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:57 user nova-compute[74870]: WARNING nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received unexpected event network-vif-unplugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance with vm_state deleted and task_state None.
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received event network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Acquiring lock "317be079-9b77-4139-88a4-36efb848c025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Lock "317be079-9b77-4139-88a4-36efb848c025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] No waiting events found dispatching network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:41:57 user nova-compute[74870]: WARNING nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received unexpected event network-vif-plugged-61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance with vm_state deleted and task_state None.
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] [instance: 317be079-9b77-4139-88a4-36efb848c025] Received event network-vif-deleted-61814597-e5ae-41b8-9cfb-2de8d8f596ef {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:57 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Deleted allocations for instance 317be079-9b77-4139-88a4-36efb848c025
Nov 28 06:41:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "317be079-9b77-4139-88a4-36efb848c025" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.899s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:41:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-changed-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Refreshing instance network info cache due to event network-changed-3910f97d-105a-4142-a3ab-effc57185190. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:42:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Acquiring lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Acquired lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:02 user nova-compute[74870]: DEBUG nova.network.neutron [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Refreshing network info cache for port 3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG nova.network.neutron [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updated VIF entry in instance network info cache for port 3910f97d-105a-4142-a3ab-effc57185190. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG nova.network.neutron [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updating instance_info_cache with network_info: [{"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Releasing lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'flavor' on Instance uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:03 user nova-compute[74870]: INFO nova.compute.manager [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Attaching volume 981eddb7-039a-4cfc-9b60-ecdebff98251 to /dev/vdb
Nov 28 06:42:03 user nova-compute[74870]: DEBUG os_brick.utils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9834d90d-b5f3-4f15-8302-b8b47d4654e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0433072c-9e9b-4b2e-a2c3-bc9563877b68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0663d10-040b-4201-a361-446128132d67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[587eed5a-2246-4323-8967-f200f156df3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:03 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:42:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e46cdb-198a-4cfb-a11e-c0ad42096be8]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG os_brick.utils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updating existing volume attachment record: 92f9c166-451d-4099-b821-3c4cd1872293 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:42:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'flavor' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:07 user nova-compute[74870]: INFO nova.compute.manager [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Attaching volume a8b4ea4e-a453-4e9f-b0cf-79f87998b488 to /dev/vdb
Nov 28 06:42:07 user nova-compute[74870]: DEBUG os_brick.utils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211c0e7-fccd-41c6-83e3-cd922a1755c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7259a6f3-42fa-4e2f-8d5c-cdfc8321de0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa497b6-1c2c-487a-858c-bea8bc1128b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[645572e2-315b-440f-9657-c4c69ae7f0ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:07 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:42:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56693e9-b925-4596-b20a-b558ab580576]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG os_brick.utils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating existing volume attachment record: aa536aff-1db6-45d3-a3f2-730480594f7f {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:42:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuRngrba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:10 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3050e3-20e4-4578-b477-996d652e0bdf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:42:10 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c8715a-298b-4842-8752-f011c7751175]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251] added
Nov 28 06:42:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d54a374-b113-4008-8263-7ef2f11bec67]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a88ca-f3f9-40b8-8e4a-8698a1144c72]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuRngrba {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuRngrba" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1146d5c-5c81-4134-b11e-6cbd5bc1c672]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BuRngrba'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2bc713-7d02-4fd4-9c0d-708436c514cf]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[633f1c03-75b9-49b7-8148-50957e482246]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:10 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:10 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:10 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:10 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5097ce1-855e-4a0f-9285-5d3b5f60b885]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260]
Nov 28 06:42:10 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a0a51-b94b-4e4b-88e3-1b553eff10ba]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66a387-e120-48a8-829e-29bd02dfc754]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a613107-9596-4848-919a-2fa4b0ee692c]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:42:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuRngrba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26231633265356431', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231633265356431', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'flavor' on Instance uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:42:12 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:12 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:42:12 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:42:12 user nova-compute[74870]:   <serial>981eddb7-039a-4cfc-9b60-ecdebff98251</serial>
Nov 28 06:42:12 user nova-compute[74870]: </disk>
Nov 28 06:42:12 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'flavor' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No VIF found with MAC fa:16:3e:ba:9d:ef, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:12 user nova-compute[74870]: INFO nova.compute.manager [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Attaching volume 7a1e0169-c086-4acb-a496-a8a00aaeca65 to /dev/vdb
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.utils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dd7432-aea0-4e19-8e28-f93a636ffc79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.480s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c35def-0e10-4e91-bddf-0e0bf4011c2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d94afc-d3e5-490e-a758-843c4f3d498a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2461a-6c94-4e57-be25-079cea703c6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:12 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:42:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df13b52-b5fe-4219-9fa9-afa2552f1e6d]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG os_brick.utils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:12 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating existing volume attachment record: 5d344f52-36e0-4c6f-b23b-8f0d15009cc8 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:42:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:14 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:14 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:14 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c490df1-a71a-4239-b1fb-7cd79a454b43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:42:14 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc479658-cdb4-4d11-b73b-6731acd7da0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488] added
Nov 28 06:42:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a50072-a49a-408b-9235-fd16c78b16a0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[83391031-349b-40f3-91b8-48179d7ccffe]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYopuWvd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYopuWvd" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1536ec-93e6-40e7-8b48-b66f47c1b93f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYopuWvd'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e2a9d-d76d-4453-8c40-c35ea6a239f1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18119ce2-f39a-4016-866f-feeb01c1fdbe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a65b08-1c6d-4430-a8c6-3cb5458e29ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]
Nov 28 06:42:15 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f663e19-d635-4816-835b-a6de3f62a5e7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e800f1e-3ab0-429f-9ec5-fe7571d8adea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e43196-37f2-41fe-ad3d-fbf1745f8636]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:15 user nova-compute[74870]: INFO nova.compute.manager [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Detaching volume 981eddb7-039a-4cfc-9b60-ecdebff98251
Nov 28 06:42:15 user nova-compute[74870]: INFO nova.virt.block_device [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Attempting to driver detach volume 981eddb7-039a-4cfc-9b60-ecdebff98251 from mountpoint /dev/vdb
Nov 28 06:42:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Attempting to detach device vdb from instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:42:15 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:15 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:42:15 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:42:15 user nova-compute[74870]:   <serial>981eddb7-039a-4cfc-9b60-ecdebff98251</serial>
Nov 28 06:42:15 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:42:15 user nova-compute[74870]: </disk>
Nov 28 06:42:15 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:42:15 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully detached device vdb from instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 from the persistent domain config.
Nov 28 06:42:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:42:15 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:15 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:42:15 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:42:15 user nova-compute[74870]:   <serial>981eddb7-039a-4cfc-9b60-ecdebff98251</serial>
Nov 28 06:42:15 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:42:15 user nova-compute[74870]: </disk>
Nov 28 06:42:15 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:42:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26433333636396337', 'path': '/dev/sde'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433333636396337', 'path': '/dev/sde'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'flavor' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:42:16 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:16 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:42:16 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:42:16 user nova-compute[74870]:   <serial>a8b4ea4e-a453-4e9f-b0cf-79f87998b488</serial>
Nov 28 06:42:16 user nova-compute[74870]: </disk>
Nov 28 06:42:16 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No VIF found with MAC fa:16:3e:dd:63:14, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.704s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:18 user nova-compute[74870]: INFO nova.compute.manager [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Terminating instance
Nov 28 06:42:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-vif-unplugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] No waiting events found dispatching network-vif-unplugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-vif-unplugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:42:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Instance destroyed successfully.
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lazy-loading 'resources' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-517497179',display_name='tempest-TestVolumeSwap-server-517497179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-517497179',id=9,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNEi3e2JzcCpkjzBEiSZvejCbft/YLFcYrQL40RNJqMTTInfT/sTCCeFwes+Tmiq9CMXCarfk+xENzowL6bsuzmSB+K0docacw1kCH/oMTX2uXVEMErv/sdXvTkTOC5sw==',key_name='tempest-keypair-926137104',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63d0402c76fe47cd8cd65d2ef23c46f8',ramdisk_id='',reservation_id='r-0wkcd3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-54352515',owner_user_name='tempest-TestVolumeSwap-54352515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7f2a6787cd478ca419181fdb7ab317',uuid=66c94c69-4907-404d-ad02-d8ba2716a4e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Converting VIF {"id": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "address": "fa:16:3e:65:c4:d1", "network": {"id": "2fa8c0e7-da73-4b99-9772-79fc2aae5970", "bridge": "br-int", "label": "tempest-TestVolumeSwap-754155806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d0402c76fe47cd8cd65d2ef23c46f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffac6e2-50", "ovs_interfaceid": "affac6e2-50a7-44d2-b7ba-ec18341bb71f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG os_vif [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaffac6e2-50, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b0fd575-3a23-47f6-8c69-ff93d175a871) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:19 user nova-compute[74870]: INFO os_vif [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c4:d1,bridge_name='br-int',has_traffic_filtering=True,id=affac6e2-50a7-44d2-b7ba-ec18341bb71f,network=Network(2fa8c0e7-da73-4b99-9772-79fc2aae5970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffac6e2-50')
Nov 28 06:42:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Deleting instance files /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7_del
Nov 28 06:42:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Deletion of /opt/stack/data/nova/instances/66c94c69-4907-404d-ad02-d8ba2716a4e7_del complete
Nov 28 06:42:19 user nova-compute[74870]: INFO nova.compute.manager [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 06:42:19 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Stashing vm_state: active {{(pid=74870) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:42:19 user nova-compute[74870]: INFO nova.compute.claims [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Claim successful on node user
Nov 28 06:42:19 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating resource usage from migration 6566d01b-b539-4af6-bfe6-db894c82f82a
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:20 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Took 0.85 seconds to deallocate network for instance.
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-vif-deleted-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.660s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:20 user nova-compute[74870]: INFO nova.compute.manager [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Migrating
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.141s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:20 user nova-compute[74870]: INFO nova.compute.rpcapi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received event network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Acquiring lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] No waiting events found dispatching network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:20 user nova-compute[74870]: WARNING nova.compute.manager [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Received unexpected event network-vif-plugged-affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance with vm_state deleted and task_state None.
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:20 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Deleted allocations for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7
Nov 28 06:42:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "66c94c69-4907-404d-ad02-d8ba2716a4e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Starting migrate_disk_and_power_off {{(pid=74870) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwZQhAgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:21 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ff2ba9-269c-43af-a335-4d355d10f7e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:42:21 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db185b-7b94-4e6c-9765-336653961309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65] added
Nov 28 06:42:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabc81e-ec21-4ae2-95d9-bb2b7568fe5c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705b4a2-e9fb-4ccb-a466-7d2144ebeac6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwZQhAgs {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwZQhAgs" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0688804-4b42-4c51-b53a-305a6a7aadfc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwZQhAgs'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6211bdf8-b9cd-470b-bbf6-bdfddd6d22a6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6109543e-2410-4a6d-b3c9-c030ef06d7a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f024c-804c-4165-b0aa-7d41a9c115fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260]
Nov 28 06:42:21 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[957bf214-472e-48a6-9385-d89ab3166459]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ae063-b321-4390-9892-adc758014b58]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda0996-bc4d-481d-9f7a-970e823088e4]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwZQhAgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-unplugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-unplugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:21 user nova-compute[74870]: WARNING nova.compute.manager [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-unplugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state active and task_state resize_migrating.
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance destroyed successfully.
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717f616f-b4, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de44a087-2b95-4eb7-a426-c9f3fbd7b35e) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:21 user nova-compute[74870]: INFO os_vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4')
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26331636464663635', 'path': '/dev/sdg'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331636464663635', 'path': '/dev/sdg'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.715s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'flavor' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63773f-56a0-4ac9-9517-3c5606331997]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:42:22 user nova-compute[74870]: No targets found.
Nov 28 06:42:22 user nova-compute[74870]: iSNS:
Nov 28 06:42:22 user nova-compute[74870]: No targets found.
Nov 28 06:42:22 user nova-compute[74870]: STATIC:
Nov 28 06:42:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:42:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251
Nov 28 06:42:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:42:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:42:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92
Nov 28 06:42:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:42:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:22 user nova-compute[74870]: FIRMWARE:
Nov 28 06:42:22 user nova-compute[74870]: No targets found.
Nov 28 06:42:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:42:22 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:42:22 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be8163-2954-4760-b85f-2b6cb39479b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:42:22 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:22 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:42:22 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:42:22 user nova-compute[74870]:   <serial>7a1e0169-c086-4acb-a496-a8a00aaeca65</serial>
Nov 28 06:42:22 user nova-compute[74870]: </disk>
Nov 28 06:42:22 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b30131e3-a805-4fbc-815c-7e379c44a386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:22 user nova-compute[74870]: INFO nova.compute.manager [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Terminating instance
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca0425c-005d-4a7f-b16d-f23b1d661a33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7dd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488'): ({'sde'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Removing single pathed devices sde {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcc3859-009f-4ca2-a528-89c5e76234e1]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cfc6a0-5790-4a5a-91e2-edbd30a462ad]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flushing IO for device /dev/sde {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9596cd07-8d1d-47bf-bf72-d7284132ef3c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff751d1-4cc6-4f23-ae63-05f7f5a2c6d1]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updating instance_info_cache with network_info: [{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[813b327b-de22-4fa1-a704-c90ef4db996e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738f48d-76f7-4f5e-a5bb-041e048abc77]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]
Nov 28 06:42:23 user nova-compute[74870]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-vif-unplugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] No waiting events found dispatching network-vif-unplugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-vif-unplugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432bd17-8ab2-4414-b706-355036147844]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.528s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== disconnect_volume: return (1242ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No VIF found with MAC fa:16:3e:21:69:bf, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.725s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7_resize/disk /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Instance destroyed successfully.
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'resources' on Instance uuid b30131e3-a805-4fbc-815c-7e379c44a386 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-184058363',display_name='tempest-AttachVolumeNegativeTest-server-184058363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-184058363',id=15,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoHWATyOznTa3QISkPxYic5CYo5gMvAHv39uglMQOy4R4C3vYAKpZGMik0+X0Bvm/kPlXlGSrDPHEXQdQpRBI9+0O95dTnBB1+GuFPUbKtFKHp29bFKjhno/xwR6OeWhA==',key_name='tempest-keypair-1335441825',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-gmx3oh2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=b30131e3-a805-4fbc-815c-7e379c44a386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG os_vif [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bf5bfdf-5d, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cdace58-aa91-49cc-8803-295c77acbd8c) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:23 user nova-compute[74870]: INFO os_vif [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:02:de,bridge_name='br-int',has_traffic_filtering=True,id=8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf5bfdf-5d')
Nov 28 06:42:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Deleting instance files /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386_del
Nov 28 06:42:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Deletion of /opt/stack/data/nova/instances/b30131e3-a805-4fbc-815c-7e379c44a386_del complete
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-changed-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Refreshing instance network info cache due to event network-changed-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Acquiring lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Acquired lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Refreshing network info cache for port 8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:42:23 user nova-compute[74870]: INFO nova.compute.manager [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:23 user nova-compute[74870]: INFO nova.compute.manager [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Rescuing
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "cp -r /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7_resize/disk /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk" returned: 0 in 0.459s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7_resize/disk.info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk.info {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "cp -r /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7_resize/disk.info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk.info" returned: 0 in 0.048s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Updated VIF entry in instance network info cache for port 8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Updating instance_info_cache with network_info: [{"id": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "address": "fa:16:3e:eb:02:de", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf5bfdf-5d", "ovs_interfaceid": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Releasing lock "refresh_cache-b30131e3-a805-4fbc-815c-7e379c44a386" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:24 user nova-compute[74870]: WARNING nova.compute.manager [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state active and task_state resize_migrating.
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Acquiring lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Lock "b30131e3-a805-4fbc-815c-7e379c44a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] No waiting events found dispatching network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:25 user nova-compute[74870]: WARNING nova.compute.manager [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received unexpected event network-vif-plugged-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance with vm_state active and task_state deleting.
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Port 717f616f-b485-4c7e-83be-a80086c19692 binding to destination host user is already ACTIVE {{(pid=74870) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 06:42:25 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Took 1.60 seconds to deallocate network for instance.
Nov 28 06:42:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-unplugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-unplugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:25 user nova-compute[74870]: WARNING nova.compute.manager [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-unplugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state active and task_state rescuing.
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Received event network-vif-deleted-8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:42:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:42:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance destroyed successfully.
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.654s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Attempting a stable device rescue
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:26 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Deleted allocations for instance b30131e3-a805-4fbc-815c-7e379c44a386
Nov 28 06:42:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:42:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Creating image(s)
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "cca08c9430bc778a6551a6a0315d2c300439773b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "cca08c9430bc778a6551a6a0315d2c300439773b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b30131e3-a805-4fbc-815c-7e379c44a386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.621s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 1.360s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG nova.virt.images [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] f40204eb-15d5-4f6d-a086-d9654a71267f was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.part /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:27 user nova-compute[74870]: WARNING nova.compute.manager [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state active and task_state rescuing.
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.part /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.converted" returned: 0 in 0.313s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.utils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d680361-9620-4ce1-b9d9-dfb0a5f3cb9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e2daf9-5ee1-41dc-8bbd-8530aaa4bfde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186afa8-fbae-48ab-94a4-1f8b3f0bd55e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22039d6-6da3-487a-801b-6abf367648f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:42:28 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[21047800-9362-4bb2-a72f-26e835992f81]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.utils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "cca08c9430bc778a6551a6a0315d2c300439773b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "cca08c9430bc778a6551a6a0315d2c300439773b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "cca08c9430bc778a6551a6a0315d2c300439773b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b,backing_fmt=raw /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b,backing_fmt=raw /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue" returned: 0 in 0.055s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "cca08c9430bc778a6551a6a0315d2c300439773b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'migration_context' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Object Instance<0e5b898b-f5f0-4504-94d0-53bf8d622620> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Start _get_guest_xml network_info=[{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "vif_mac": "fa:16:3e:21:69:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f40204eb-15d5-4f6d-a086-d9654a71267f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwZQhAgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '0e5b898b-f5f0-4504-94d0-53bf8d622620', 'attached_at': '', 'detached_at': '', 'volume_id': '7a1e0169-c086-4acb-a496-a8a00aaeca65', 'serial': '7a1e0169-c086-4acb-a496-a8a00aaeca65'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '5d344f52-36e0-4c6f-b23b-8f0d15009cc8', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'resources' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Object Instance<0e5b898b-f5f0-4504-94d0-53bf8d622620> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'numa_topology' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Object Instance<0e5b898b-f5f0-4504-94d0-53bf8d622620> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Object Instance<0e5b898b-f5f0-4504-94d0-53bf8d622620> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwZQhAgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:28 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:42:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c41310-9ecb-4420-9ed4-40276aaa3b10]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nwZQhAgs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 06:42:28 user nova-compute[74870]: node.name = iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:42:28 user nova-compute[74870]: node.tpgt = -1
Nov 28 06:42:28 user nova-compute[74870]: node.startup = automatic
Nov 28 06:42:28 user nova-compute[74870]: node.leading_login = No
Nov 28 06:42:28 user nova-compute[74870]: iface.iscsi_ifacename = default
Nov 28 06:42:28 user nova-compute[74870]: iface.net_ifacename = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.ipaddress = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.prefix_len = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.hwaddress = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.transport_name = tcp
Nov 28 06:42:28 user nova-compute[74870]: iface.initiatorname = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.vlan_id = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.vlan_priority = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.vlan_state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.iface_num = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.mtu = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.port = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.bootproto = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.subnet_mask = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.gateway = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_alt_client_id = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_dns = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_learn_iqn = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_vendor_id_state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_vendor_id = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.dhcp_slp_da = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.fragmentation = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.gratuitous_arp = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.incoming_forwarding = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.tos_state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.tos = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.ttl = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.delayed_ack = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.tcp_nagle = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.tcp_wsf_state = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.tcp_wsf = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.tcp_timer_scale = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.tcp_timestamp = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.redirect = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.def_task_mgmt_timeout = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.header_digest = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.data_digest = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.immediate_data = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.initial_r2t = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.data_seq_inorder = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.data_pdu_inorder = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.erl = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.max_receive_data_len = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.first_burst_len = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.max_outstanding_r2t = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.max_burst_len = 0
Nov 28 06:42:28 user nova-compute[74870]: iface.chap_auth = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.bidi_chap = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.strict_login_compliance = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.discovery_auth = <empty>
Nov 28 06:42:28 user nova-compute[74870]: iface.discovery_logout = <empty>
Nov 28 06:42:28 user nova-compute[74870]: node.discovery_address = <empty>
Nov 28 06:42:28 user nova-compute[74870]: node.discovery_port = 0
Nov 28 06:42:28 user nova-compute[74870]: node.discovery_type = static
Nov 28 06:42:28 user nova-compute[74870]: node.session.initial_cmdsn = 0
Nov 28 06:42:28 user nova-compute[74870]: node.session.initial_login_retry_max = 8
Nov 28 06:42:28 user nova-compute[74870]: node.session.xmit_thread_priority = -20
Nov 28 06:42:28 user nova-compute[74870]: node.session.cmds_max = 128
Nov 28 06:42:28 user nova-compute[74870]: node.session.queue_depth = 32
Nov 28 06:42:28 user nova-compute[74870]: node.session.nr_sessions = 1
Nov 28 06:42:28 user nova-compute[74870]: node.session.auth.authmethod = CHAP
Nov 28 06:42:28 user nova-compute[74870]: node.session.auth.username = nwZQhAgs
Nov 28 06:42:28 user nova-compute[74870]: node.session.auth.password = ***
Nov 28 06:42:28 user nova-compute[74870]: node.session.auth.username_in = <empty>
Nov 28 06:42:28 user nova-compute[74870]: node.session.auth.password_in = <empty>
Nov 28 06:42:28 user nova-compute[74870]: node.session.auth.chap_algs = MD5
Nov 28 06:42:28 user nova-compute[74870]: node.session.timeo.replacement_timeout = 120
Nov 28 06:42:28 user nova-compute[74870]: node.session.err_timeo.abort_timeout = 15
Nov 28 06:42:28 user nova-compute[74870]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 06:42:28 user nova-compute[74870]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 06:42:28 user nova-compute[74870]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.FastAbort = Yes
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.InitialR2T = No
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.ImmediateData = Yes
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.MaxConnections = 1
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 06:42:28 user nova-compute[74870]: node.session.iscsi.ERL = 0
Nov 28 06:42:28 user nova-compute[74870]: node.session.scan = manual
Nov 28 06:42:28 user nova-compute[74870]: node.session.reopen_max = 0
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].address = 172.16.0.220
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].port = 3260
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].startup = manual
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].tcp.window_size = 524288
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].tcp.type_of_service = 0
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].timeo.logout_timeout = 15
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].timeo.login_timeout = 15
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].timeo.auth_timeout = 45
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].iscsi.DataDigest = None
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].iscsi.IFMarker = No
Nov 28 06:42:28 user nova-compute[74870]: node.conn[0].iscsi.OFMarker = No
Nov 28 06:42:28 user nova-compute[74870]: # END RECORD
Nov 28 06:42:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e077f-9d6d-4fca-8cc2-1ea5afe1ad79]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92ead9-b034-4a98-9a55-b9530a38b466]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwZQhAgs {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwZQhAgs" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace3ac59-94a9-4c0f-93a8-b626f5fa54fa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwZQhAgs'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3ea81d-b79f-4eae-a922-15be24a87cad]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[088932af-b1a3-47be-a968-b771ffd859a5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.204s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] HCTL ('38', '0', '0', 0) found on session 17 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[377acceb-67e2-4c9d-b486-ac073d651969]: (4, ('0 0 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Searching for a device in session 17 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwZQhAgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.231s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '26331636464663635', 'path': '/dev/sdg'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331636464663635', 'path': '/dev/sdg'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-692038908',display_name='tempest-ServerStableDeviceRescueTest-server-692038908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-692038908',id=7,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFaerc1nUtKDnRM+r90VFYRGdV10VQFWDLQhuqYU/TPWJ+sUFq9W+68zFlEuxEiYAsWAKxBO79ot31nQIU3RWockau4p3vhK1K7n+Hcw0HsUre+LAFsc8TGx8g99OMQA==',key_name='tempest-keypair-142163135',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b30dc21619f949b18be9362b217e7c1b',ramdisk_id='',reservation_id='r-aiq041ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1091796361',owner_user_name='tempest-ServerStableDeviceRescueTest-1091796361-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f53e7a2f95545d196a5b2d36ef6d692',uuid=0e5b898b-f5f0-4504-94d0-53bf8d622620,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "vif_mac": "fa:16:3e:21:69:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converting VIF {"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "vif_mac": "fa:16:3e:21:69:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.objects.base [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Object Instance<0e5b898b-f5f0-4504-94d0-53bf8d622620> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:42:28 user nova-compute[74870]:   <uuid>0e5b898b-f5f0-4504-94d0-53bf8d622620</uuid>
Nov 28 06:42:28 user nova-compute[74870]:   <name>instance-00000007</name>
Nov 28 06:42:28 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:42:28 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:42:28 user nova-compute[74870]:   <metadata>
Nov 28 06:42:28 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:42:28 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:42:28 user nova-compute[74870]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-692038908</nova:name>
Nov 28 06:42:28 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:42:28</nova:creationTime>
Nov 28 06:42:28 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:42:28 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:42:28 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:42:28 user nova-compute[74870]:       <nova:owner>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:user uuid="4f53e7a2f95545d196a5b2d36ef6d692">tempest-ServerStableDeviceRescueTest-1091796361-project-member</nova:user>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:project uuid="b30dc21619f949b18be9362b217e7c1b">tempest-ServerStableDeviceRescueTest-1091796361</nova:project>
Nov 28 06:42:28 user nova-compute[74870]:       </nova:owner>
Nov 28 06:42:28 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:42:28 user nova-compute[74870]:       <nova:ports>
Nov 28 06:42:28 user nova-compute[74870]:         <nova:port uuid="d2a8e63d-4f39-4ef4-9d23-ad1f72acb858">
Nov 28 06:42:28 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:42:28 user nova-compute[74870]:         </nova:port>
Nov 28 06:42:28 user nova-compute[74870]:       </nova:ports>
Nov 28 06:42:28 user nova-compute[74870]:     </nova:instance>
Nov 28 06:42:28 user nova-compute[74870]:   </metadata>
Nov 28 06:42:28 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:42:28 user nova-compute[74870]:     <system>
Nov 28 06:42:28 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:42:28 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:42:28 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:42:28 user nova-compute[74870]:       <entry name="serial">0e5b898b-f5f0-4504-94d0-53bf8d622620</entry>
Nov 28 06:42:28 user nova-compute[74870]:       <entry name="uuid">0e5b898b-f5f0-4504-94d0-53bf8d622620</entry>
Nov 28 06:42:28 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:42:28 user nova-compute[74870]:     </system>
Nov 28 06:42:28 user nova-compute[74870]:   </sysinfo>
Nov 28 06:42:28 user nova-compute[74870]:   <os>
Nov 28 06:42:28 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:42:28 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:42:28 user nova-compute[74870]:   </os>
Nov 28 06:42:28 user nova-compute[74870]:   <features>
Nov 28 06:42:28 user nova-compute[74870]:     <acpi/>
Nov 28 06:42:28 user nova-compute[74870]:     <apic/>
Nov 28 06:42:28 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:42:28 user nova-compute[74870]:   </features>
Nov 28 06:42:28 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:42:28 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:42:28 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:42:28 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:42:28 user nova-compute[74870]:   </clock>
Nov 28 06:42:28 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:42:28 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:42:28 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:42:28 user nova-compute[74870]:   </cpu>
Nov 28 06:42:28 user nova-compute[74870]:   <devices>
Nov 28 06:42:28 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:42:28 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:42:28 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk"/>
Nov 28 06:42:28 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:42:28 user nova-compute[74870]:     </disk>
Nov 28 06:42:28 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:42:28 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:28 user nova-compute[74870]:       <source dev="/dev/sdg"/>
Nov 28 06:42:28 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:42:28 user nova-compute[74870]:       <serial>7a1e0169-c086-4acb-a496-a8a00aaeca65</serial>
Nov 28 06:42:28 user nova-compute[74870]:     </disk>
Nov 28 06:42:28 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:42:28 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:42:28 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue"/>
Nov 28 06:42:28 user nova-compute[74870]:       <target dev="vdc" bus="virtio"/>
Nov 28 06:42:28 user nova-compute[74870]:       <boot order="1"/>
Nov 28 06:42:28 user nova-compute[74870]:     </disk>
Nov 28 06:42:28 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:42:28 user nova-compute[74870]:       <mac address="fa:16:3e:21:69:bf"/>
Nov 28 06:42:28 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:28 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:42:28 user nova-compute[74870]:       <target dev="tapd2a8e63d-4f"/>
Nov 28 06:42:28 user nova-compute[74870]:     </interface>
Nov 28 06:42:28 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:42:28 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/console.log" append="off"/>
Nov 28 06:42:28 user nova-compute[74870]:     </serial>
Nov 28 06:42:28 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:42:28 user nova-compute[74870]:     <video>
Nov 28 06:42:28 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:28 user nova-compute[74870]:     </video>
Nov 28 06:42:28 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:42:28 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:42:28 user nova-compute[74870]:     </rng>
Nov 28 06:42:28 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:42:28 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:42:28 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:42:28 user nova-compute[74870]:     </memballoon>
Nov 28 06:42:28 user nova-compute[74870]:   </devices>
Nov 28 06:42:28 user nova-compute[74870]: </domain>
Nov 28 06:42:28 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:42:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance destroyed successfully.
Nov 28 06:42:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] No VIF found with MAC fa:16:3e:21:69:bf, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:42:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:31 user nova-compute[74870]: WARNING nova.compute.manager [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state active and task_state rescuing.
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:32 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'b30131e3-a805-4fbc-815c-7e379c44a386' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b30131e3-a805-4fbc-815c-7e379c44a386' (instance-0000000f)
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:33 user nova-compute[74870]: WARNING nova.compute.manager [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state active and task_state rescuing.
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:42:33 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:33 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7505MB free_disk=25.534542083740234GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Applying migration context for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 as it has an incoming, in-progress migration 6566d01b-b539-4af6-bfe6-db894c82f82a. Migration status is post-migrating {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 06:42:33 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating resource usage from migration 6566d01b-b539-4af6-bfe6-db894c82f82a
Nov 28 06:42:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance b4802806-6422-46da-8d0f-5674af0a8433 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 70280af1-c742-4096-9abc-7a1ca9b44079 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 93f30c00-ea3c-445c-b0c9-5ef899412580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Migration 6566d01b-b539-4af6-bfe6-db894c82f82a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:42:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:42:34 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:42:34 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:42:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:42:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:35 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 is timed out.
Nov 28 06:42:35 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully detached device vdb from instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 from the live domain config.
Nov 28 06:42:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuRngrba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:35 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf813c-a46e-44c7-bfc2-522207af8898]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:42:35 user nova-compute[74870]: No targets found.
Nov 28 06:42:35 user nova-compute[74870]: iSNS:
Nov 28 06:42:35 user nova-compute[74870]: No targets found.
Nov 28 06:42:35 user nova-compute[74870]: STATIC:
Nov 28 06:42:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:42:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251
Nov 28 06:42:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:42:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92
Nov 28 06:42:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:42:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:35 user nova-compute[74870]: FIRMWARE:
Nov 28 06:42:35 user nova-compute[74870]: No targets found.
Nov 28 06:42:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:42:35 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:42:35 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ac8aa-ef29-4ff5-9949-d17b0c6f1dd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Starting finish_migration {{(pid=74870) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:42:35 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Creating image(s)
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc68e1-50c4-4758-9484-885a8af433a5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefd1d2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[83644068-0122-47ed-895f-1d18506eeadc]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.059s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bfaa12-a35a-42e0-9e4d-0f695b518389]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:42:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2120130-e3af-4d9f-b55c-33e1fa34b2ce]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk. size=21474836480 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8062520-e7af-4e76-a821-32b9a546067e]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d4590b-494e-4bbd-a4cf-c826b38f9f2a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f4d544-4427-400f-99d2-0a81e915598b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260]
Nov 28 06:42:36 user nova-compute[74870]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981eddb7-039a-4cfc-9b60-ecdebff98251 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb57cd93-ba6a-4bb5-8bef-4b4fdb4d90f9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] <== disconnect_volume: return (450ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk 21474836480 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk 21474836480" returned: 0 in 0.045s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Ensure instance console log exists: /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start _get_guest_xml network_info=[{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '41240cc1-28a3-4685-9f80-68f5e37945b7', 'attached_at': '2023-11-28T06:42:36.000000', 'detached_at': '', 'volume_id': 'a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'serial': 'a8b4ea4e-a453-4e9f-b0cf-79f87998b488'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'd80c4e93-1843-4dd6-968b-acd93c076b4f', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:42:36 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:36 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:36 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:36 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:36 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:42:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be38a6b-86b0-42d4-8d93-cc156174716e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:42:36 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0367e2-30c1-41ae-814f-81411fae8fd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488] added
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8078e6b-f739-48ce-b9d3-c2db597e1acf]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77fe155-8354-4493-b05e-93348d0f285e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYopuWvd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYopuWvd" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7197e57-c18d-4744-99fb-21a376396798]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYopuWvd'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a8b4d5-03b9-4a4a-a5f2-017d25ec3b29]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a188cea7-df64-464b-93e6-c12d19d90c8f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[04004dd8-8e5f-4e47-bb15-eff5a499c723]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]
Nov 28 06:42:36 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c3a4c-1942-4334-8f80-ff92e277d256]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b1ae3-7bb1-472e-9dc7-65b200c9d7c7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:36 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f2b85d-e850-446a-a06c-bebefe9eefcd]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:42:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'flavor' on Instance uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.048s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26433333636396337', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433333636396337', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:42:37 user nova-compute[74870]:   <uuid>41240cc1-28a3-4685-9f80-68f5e37945b7</uuid>
Nov 28 06:42:37 user nova-compute[74870]:   <name>instance-00000006</name>
Nov 28 06:42:37 user nova-compute[74870]:   <memory>2097152</memory>
Nov 28 06:42:37 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:42:37 user nova-compute[74870]:   <metadata>
Nov 28 06:42:37 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:42:37 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:42:37 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherB-server-1411738955</nova:name>
Nov 28 06:42:37 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:42:36</nova:creationTime>
Nov 28 06:42:37 user nova-compute[74870]:       <nova:flavor name="m1.small">
Nov 28 06:42:37 user nova-compute[74870]:         <nova:memory>2048</nova:memory>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:disk>20</nova:disk>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:42:37 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:42:37 user nova-compute[74870]:       <nova:owner>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:user uuid="18ee95f099b64968984fd3b9e418b048">tempest-ServerActionsTestOtherB-1422366079-project-member</nova:user>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:project uuid="739e836995bb4af6a877468ec43d0cf3">tempest-ServerActionsTestOtherB-1422366079</nova:project>
Nov 28 06:42:37 user nova-compute[74870]:       </nova:owner>
Nov 28 06:42:37 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:42:37 user nova-compute[74870]:       <nova:ports>
Nov 28 06:42:37 user nova-compute[74870]:         <nova:port uuid="717f616f-b485-4c7e-83be-a80086c19692">
Nov 28 06:42:37 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 06:42:37 user nova-compute[74870]:         </nova:port>
Nov 28 06:42:37 user nova-compute[74870]:       </nova:ports>
Nov 28 06:42:37 user nova-compute[74870]:     </nova:instance>
Nov 28 06:42:37 user nova-compute[74870]:   </metadata>
Nov 28 06:42:37 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:42:37 user nova-compute[74870]:     <system>
Nov 28 06:42:37 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:42:37 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:42:37 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:42:37 user nova-compute[74870]:       <entry name="serial">41240cc1-28a3-4685-9f80-68f5e37945b7</entry>
Nov 28 06:42:37 user nova-compute[74870]:       <entry name="uuid">41240cc1-28a3-4685-9f80-68f5e37945b7</entry>
Nov 28 06:42:37 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:42:37 user nova-compute[74870]:     </system>
Nov 28 06:42:37 user nova-compute[74870]:   </sysinfo>
Nov 28 06:42:37 user nova-compute[74870]:   <os>
Nov 28 06:42:37 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:42:37 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:42:37 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:42:37 user nova-compute[74870]:   </os>
Nov 28 06:42:37 user nova-compute[74870]:   <features>
Nov 28 06:42:37 user nova-compute[74870]:     <acpi/>
Nov 28 06:42:37 user nova-compute[74870]:     <apic/>
Nov 28 06:42:37 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:42:37 user nova-compute[74870]:   </features>
Nov 28 06:42:37 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:42:37 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:42:37 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:42:37 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:42:37 user nova-compute[74870]:   </clock>
Nov 28 06:42:37 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:42:37 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:42:37 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:42:37 user nova-compute[74870]:   </cpu>
Nov 28 06:42:37 user nova-compute[74870]:   <devices>
Nov 28 06:42:37 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:42:37 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:42:37 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk"/>
Nov 28 06:42:37 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:42:37 user nova-compute[74870]:     </disk>
Nov 28 06:42:37 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:42:37 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:42:37 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:42:37 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:42:37 user nova-compute[74870]:       <serial>a8b4ea4e-a453-4e9f-b0cf-79f87998b488</serial>
Nov 28 06:42:37 user nova-compute[74870]:     </disk>
Nov 28 06:42:37 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:42:37 user nova-compute[74870]:       <mac address="fa:16:3e:dd:63:14"/>
Nov 28 06:42:37 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:37 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:42:37 user nova-compute[74870]:       <target dev="tap717f616f-b4"/>
Nov 28 06:42:37 user nova-compute[74870]:     </interface>
Nov 28 06:42:37 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:42:37 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/console.log" append="off"/>
Nov 28 06:42:37 user nova-compute[74870]:     </serial>
Nov 28 06:42:37 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:42:37 user nova-compute[74870]:     <video>
Nov 28 06:42:37 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:37 user nova-compute[74870]:     </video>
Nov 28 06:42:37 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:42:37 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:42:37 user nova-compute[74870]:     </rng>
Nov 28 06:42:37 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:42:37 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:42:37 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:42:37 user nova-compute[74870]:     </memballoon>
Nov 28 06:42:37 user nova-compute[74870]:   </devices>
Nov 28 06:42:37 user nova-compute[74870]: </domain>
Nov 28 06:42:37 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-488960258-network", "vif_mac": "fa:16:3e:dd:63:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG os_vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb571cf-ade1-590c-bba5-f636e398fb6c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717f616f-b4, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap717f616f-b4, col_values=(('qos', UUID('e77f8fb8-aca7-44cc-a456-ee85e3f780de')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap717f616f-b4, col_values=(('external_ids', {'iface-id': '717f616f-b485-4c7e-83be-a80086c19692', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:63:14', 'vm-uuid': '41240cc1-28a3-4685-9f80-68f5e37945b7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:37 user nova-compute[74870]: INFO os_vif [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4')
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] No VIF found with MAC fa:16:3e:dd:63:14, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:42:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:42:39 user nova-compute[74870]: INFO nova.compute.claims [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Claim successful on node user
Nov 28 06:42:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:42:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:42:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.policy [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:42:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Creating image(s)
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "/opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "/opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk 1073741824" returned: 0 in 0.055s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Successfully created port: 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:42:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Cannot resize image /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Ensure instance console log exists: /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Successfully updated port: 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-changed-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Refreshing instance network info cache due to event network-changed-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Instance network_info: |[{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Refreshing network info cache for port 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Start _get_guest_xml network_info=[{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:42:41 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:41 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525899682',display_name='tempest-ServerActionsTestOtherA-server-1525899682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525899682',id=18,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-5wbgup3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=5e69254a-5914-4e90-ae6e-bdf28ac716e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e69254a-5914-4e90-ae6e-bdf28ac716e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:42:41 user nova-compute[74870]:   <uuid>5e69254a-5914-4e90-ae6e-bdf28ac716e7</uuid>
Nov 28 06:42:41 user nova-compute[74870]:   <name>instance-00000012</name>
Nov 28 06:42:41 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:42:41 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:42:41 user nova-compute[74870]:   <metadata>
Nov 28 06:42:41 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:42:41 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:42:41 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherA-server-1525899682</nova:name>
Nov 28 06:42:41 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:42:41</nova:creationTime>
Nov 28 06:42:41 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:42:41 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:42:41 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:42:41 user nova-compute[74870]:       <nova:owner>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:user uuid="b7b9a26798e14399ac1a70568432485e">tempest-ServerActionsTestOtherA-1541374155-project-member</nova:user>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:project uuid="ccf9caaf7cab4c0eb3343ea2c2501481">tempest-ServerActionsTestOtherA-1541374155</nova:project>
Nov 28 06:42:41 user nova-compute[74870]:       </nova:owner>
Nov 28 06:42:41 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:42:41 user nova-compute[74870]:       <nova:ports>
Nov 28 06:42:41 user nova-compute[74870]:         <nova:port uuid="29bc4fb8-446c-405d-a18f-e0bf5bc21fc9">
Nov 28 06:42:41 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:42:41 user nova-compute[74870]:         </nova:port>
Nov 28 06:42:41 user nova-compute[74870]:       </nova:ports>
Nov 28 06:42:41 user nova-compute[74870]:     </nova:instance>
Nov 28 06:42:41 user nova-compute[74870]:   </metadata>
Nov 28 06:42:41 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:42:41 user nova-compute[74870]:     <system>
Nov 28 06:42:41 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:42:41 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:42:41 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:42:41 user nova-compute[74870]:       <entry name="serial">5e69254a-5914-4e90-ae6e-bdf28ac716e7</entry>
Nov 28 06:42:41 user nova-compute[74870]:       <entry name="uuid">5e69254a-5914-4e90-ae6e-bdf28ac716e7</entry>
Nov 28 06:42:41 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:42:41 user nova-compute[74870]:     </system>
Nov 28 06:42:41 user nova-compute[74870]:   </sysinfo>
Nov 28 06:42:41 user nova-compute[74870]:   <os>
Nov 28 06:42:41 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:42:41 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:42:41 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:42:41 user nova-compute[74870]:   </os>
Nov 28 06:42:41 user nova-compute[74870]:   <features>
Nov 28 06:42:41 user nova-compute[74870]:     <acpi/>
Nov 28 06:42:41 user nova-compute[74870]:     <apic/>
Nov 28 06:42:41 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:42:41 user nova-compute[74870]:   </features>
Nov 28 06:42:41 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:42:41 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:42:41 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:42:41 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:42:41 user nova-compute[74870]:   </clock>
Nov 28 06:42:41 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:42:41 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:42:41 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:42:41 user nova-compute[74870]:   </cpu>
Nov 28 06:42:41 user nova-compute[74870]:   <devices>
Nov 28 06:42:41 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:42:41 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:42:41 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk"/>
Nov 28 06:42:41 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:42:41 user nova-compute[74870]:     </disk>
Nov 28 06:42:41 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:42:41 user nova-compute[74870]:       <mac address="fa:16:3e:79:b3:8b"/>
Nov 28 06:42:41 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:41 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:42:41 user nova-compute[74870]:       <target dev="tap29bc4fb8-44"/>
Nov 28 06:42:41 user nova-compute[74870]:     </interface>
Nov 28 06:42:41 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:42:41 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/console.log" append="off"/>
Nov 28 06:42:41 user nova-compute[74870]:     </serial>
Nov 28 06:42:41 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:42:41 user nova-compute[74870]:     <video>
Nov 28 06:42:41 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:41 user nova-compute[74870]:     </video>
Nov 28 06:42:41 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:42:41 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:42:41 user nova-compute[74870]:     </rng>
Nov 28 06:42:41 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:42:41 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:42:41 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:42:41 user nova-compute[74870]:     </memballoon>
Nov 28 06:42:41 user nova-compute[74870]:   </devices>
Nov 28 06:42:41 user nova-compute[74870]: </domain>
Nov 28 06:42:41 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525899682',display_name='tempest-ServerActionsTestOtherA-server-1525899682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525899682',id=18,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-5wbgup3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=5e69254a-5914-4e90-ae6e-bdf28ac716e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG os_vif [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a17b7740-3494-5106-8038-5daa6b96cd3b', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance running successfully.
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29bc4fb8-44, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29bc4fb8-44, col_values=(('qos', UUID('1ef7a136-91e4-4dcf-93dc-2cde446fb8af')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29bc4fb8-44, col_values=(('external_ids', {'iface-id': '29bc4fb8-446c-405d-a18f-e0bf5bc21fc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:b3:8b', 'vm-uuid': '5e69254a-5914-4e90-ae6e-bdf28ac716e7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Failed to set time: agent not configured {{(pid=74870) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] finish_migration finished successfully. {{(pid=74870) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:41 user nova-compute[74870]: INFO os_vif [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44')
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No VIF found with MAC fa:16:3e:79:b3:8b, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updated VIF entry in instance network info cache for port 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:42 user nova-compute[74870]: WARNING nova.compute.manager [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state resized and task_state None.
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] No waiting events found dispatching network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:43 user nova-compute[74870]: WARNING nova.compute.manager [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received unexpected event network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance with vm_state building and task_state spawning.
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:44 user nova-compute[74870]: WARNING nova.compute.manager [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state resized and task_state None.
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:45 user nova-compute[74870]: INFO nova.compute.manager [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Terminating instance
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] No waiting events found dispatching network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:45 user nova-compute[74870]: WARNING nova.compute.manager [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received unexpected event network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance with vm_state building and task_state spawning.
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:42:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Instance spawned successfully.
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:42:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Instance destroyed successfully.
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lazy-loading 'resources' on Instance uuid 70280af1-c742-4096-9abc-7a1ca9b44079 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1780739755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1245407202',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg==',key_name='tempest-keypair-885228878',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:41:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff4ac048770a4680a35f71465d191d49',ramdisk_id='',reservation_id='r-l9wr9xfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-960022347',owner_user_name='tempest-ServerActionsV293TestJSON-960022347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48e7c51916684bec98970a963f2c560e',uuid=70280af1-c742-4096-9abc-7a1ca9b44079,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converting VIF {"id": "e8244d47-16b3-4035-8877-b5d7b137dea6", "address": "fa:16:3e:4b:80:9f", "network": {"id": "93e28135-a46b-4832-9244-5f214e1915c4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520563172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4ac048770a4680a35f71465d191d49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8244d47-16", "ovs_interfaceid": "e8244d47-16b3-4035-8877-b5d7b137dea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_vif [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8244d47-16, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a01246d-1058-4218-8f7f-7f7c325be1f4) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:46 user nova-compute[74870]: INFO os_vif [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e8244d47-16b3-4035-8877-b5d7b137dea6,network=Network(93e28135-a46b-4832-9244-5f214e1915c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8244d47-16')
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBFAvuXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:42:46 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.069s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faf6fe5-7ed0-421d-92ab-cbdcf9b852d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:42:46 user nova-compute[74870]: No targets found.
Nov 28 06:42:46 user nova-compute[74870]: iSNS:
Nov 28 06:42:46 user nova-compute[74870]: No targets found.
Nov 28 06:42:46 user nova-compute[74870]: STATIC:
Nov 28 06:42:46 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:42:46 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:46 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:46 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:42:46 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:46 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:46 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:42:46 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:46 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:46 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92
Nov 28 06:42:46 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:46 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:46 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:42:46 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:42:46 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:42:46 user nova-compute[74870]: FIRMWARE:
Nov 28 06:42:46 user nova-compute[74870]: No targets found.
Nov 28 06:42:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:42:46 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:42:46 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: INFO nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4dac5-1baa-4c4b-9478-24805924d299]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec8e24b-cdb5-482a-8ef0-baccca3f0821]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:42:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7dfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d97672-8496-4156-bece-95e42b442395]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1445d1-cf6c-42e3-994e-4e1bc674a973]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544dca6-2a1d-4a7c-9a38-58c78d4a7f48]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: INFO nova.compute.manager [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Took 7.02 seconds to build instance.
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e959a65-9fcd-43be-923c-7ca1536b5a1a]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd658e32f-94e198d498acb54d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d658e32f', '/dev/disk/by-id/scsi-23934653139386434') {{(pid=85885) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 06:42:46 user nova-compute[74870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd658e32f-94e198d498acb54d
Nov 28 06:42:46 user nova-compute[74870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d658e32f
Nov 28 06:42:46 user nova-compute[74870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23934653139386434
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf697bb-1443-4c23-896c-d71d9ad30163]: (4, None) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.122s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa921f56-3681-4816-81ed-4ad2fe883ba0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-unplugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-unplugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-unplugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Acquiring lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Lock "70280af1-c742-4096-9abc-7a1ca9b44079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] No waiting events found dispatching network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:46 user nova-compute[74870]: WARNING nova.compute.manager [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received unexpected event network-vif-plugged-e8244d47-16b3-4035-8877-b5d7b137dea6 for instance with vm_state active and task_state deleting.
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abfe71c-afc8-4d8b-9855-e9631814a0ee]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260]
Nov 28 06:42:46 user nova-compute[74870]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92, portal: 172.16.0.220,3260] successful.
Nov 28 06:42:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a37c70-4bab-43d4-8197-4d80385698d0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] <== disconnect_volume: return (497ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:42:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Deleting instance files /opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079_del
Nov 28 06:42:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Deletion of /opt/stack/data/nova/instances/70280af1-c742-4096-9abc-7a1ca9b44079_del complete
Nov 28 06:42:46 user nova-compute[74870]: INFO nova.compute.manager [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 28 06:42:46 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:42:46 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:42:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:47 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:47 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Took 1.03 seconds to deallocate network for instance.
Nov 28 06:42:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Received event network-vif-deleted-e8244d47-16b3-4035-8877-b5d7b137dea6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:48 user nova-compute[74870]: INFO nova.compute.manager [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Took 1.07 seconds to detach 1 volumes for instance.
Nov 28 06:42:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Deleting volume: 1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 {{(pid=74870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 06:42:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:49 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:42:49 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:42:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:49 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Deleted allocations for instance 70280af1-c742-4096-9abc-7a1ca9b44079
Nov 28 06:42:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "70280af1-c742-4096-9abc-7a1ca9b44079" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.356s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:57 user nova-compute[74870]: INFO nova.compute.manager [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Rescuing
Nov 28 06:42:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:42:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:42:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:42:58 user nova-compute[74870]: WARNING nova.compute.manager [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state active and task_state rescuing.
Nov 28 06:42:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:42:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance destroyed successfully.
Nov 28 06:42:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Attempting rescue
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:42:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Creating image(s)
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'trusted_certs' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue" returned: 0 in 0.132s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'migration_context' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.base [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<37549ec7-6ded-412f-8a4f-58a7469e4cd1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Start _get_guest_xml network_info=[{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:c3:cb:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'resources' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.base [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<37549ec7-6ded-412f-8a4f-58a7469e4cd1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'numa_topology' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.base [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<37549ec7-6ded-412f-8a4f-58a7469e4cd1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:59 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:59 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.base [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<37549ec7-6ded-412f-8a4f-58a7469e4cd1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-863344240',display_name='tempest-ServerRescueNegativeTestJSON-server-863344240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-863344240',id=1,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-3lv7qxhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:38:31Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=37549ec7-6ded-412f-8a4f-58a7469e4cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:c3:cb:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:c3:cb:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'pci_devices' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.objects.base [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<37549ec7-6ded-412f-8a4f-58a7469e4cd1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:42:59 user nova-compute[74870]:   <uuid>37549ec7-6ded-412f-8a4f-58a7469e4cd1</uuid>
Nov 28 06:42:59 user nova-compute[74870]:   <name>instance-00000001</name>
Nov 28 06:42:59 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:42:59 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:42:59 user nova-compute[74870]:   <metadata>
Nov 28 06:42:59 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:42:59 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:42:59 user nova-compute[74870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-863344240</nova:name>
Nov 28 06:42:59 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:42:59</nova:creationTime>
Nov 28 06:42:59 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:42:59 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:42:59 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:42:59 user nova-compute[74870]:       <nova:owner>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:user uuid="109001cce8ec4aa0b87f271b415cd5e6">tempest-ServerRescueNegativeTestJSON-226827849-project-member</nova:user>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:project uuid="8f90603ba77644568ec6f6fd37689a08">tempest-ServerRescueNegativeTestJSON-226827849</nova:project>
Nov 28 06:42:59 user nova-compute[74870]:       </nova:owner>
Nov 28 06:42:59 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:42:59 user nova-compute[74870]:       <nova:ports>
Nov 28 06:42:59 user nova-compute[74870]:         <nova:port uuid="63ce66df-1214-4fbb-a8f5-8d08c9fb640f">
Nov 28 06:42:59 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 06:42:59 user nova-compute[74870]:         </nova:port>
Nov 28 06:42:59 user nova-compute[74870]:       </nova:ports>
Nov 28 06:42:59 user nova-compute[74870]:     </nova:instance>
Nov 28 06:42:59 user nova-compute[74870]:   </metadata>
Nov 28 06:42:59 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:42:59 user nova-compute[74870]:     <system>
Nov 28 06:42:59 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:42:59 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:42:59 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:42:59 user nova-compute[74870]:       <entry name="serial">37549ec7-6ded-412f-8a4f-58a7469e4cd1</entry>
Nov 28 06:42:59 user nova-compute[74870]:       <entry name="uuid">37549ec7-6ded-412f-8a4f-58a7469e4cd1</entry>
Nov 28 06:42:59 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:42:59 user nova-compute[74870]:     </system>
Nov 28 06:42:59 user nova-compute[74870]:   </sysinfo>
Nov 28 06:42:59 user nova-compute[74870]:   <os>
Nov 28 06:42:59 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:42:59 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:42:59 user nova-compute[74870]:   </os>
Nov 28 06:42:59 user nova-compute[74870]:   <features>
Nov 28 06:42:59 user nova-compute[74870]:     <acpi/>
Nov 28 06:42:59 user nova-compute[74870]:     <apic/>
Nov 28 06:42:59 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:42:59 user nova-compute[74870]:   </features>
Nov 28 06:42:59 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:42:59 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:42:59 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:42:59 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:42:59 user nova-compute[74870]:   </clock>
Nov 28 06:42:59 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:42:59 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:42:59 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:42:59 user nova-compute[74870]:   </cpu>
Nov 28 06:42:59 user nova-compute[74870]:   <devices>
Nov 28 06:42:59 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:42:59 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:42:59 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue"/>
Nov 28 06:42:59 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:42:59 user nova-compute[74870]:     </disk>
Nov 28 06:42:59 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:42:59 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:42:59 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk"/>
Nov 28 06:42:59 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:42:59 user nova-compute[74870]:     </disk>
Nov 28 06:42:59 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:42:59 user nova-compute[74870]:       <mac address="fa:16:3e:c3:cb:4e"/>
Nov 28 06:42:59 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:59 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:42:59 user nova-compute[74870]:       <target dev="tap63ce66df-12"/>
Nov 28 06:42:59 user nova-compute[74870]:     </interface>
Nov 28 06:42:59 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:42:59 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/console.log" append="off"/>
Nov 28 06:42:59 user nova-compute[74870]:     </serial>
Nov 28 06:42:59 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:42:59 user nova-compute[74870]:     <video>
Nov 28 06:42:59 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:42:59 user nova-compute[74870]:     </video>
Nov 28 06:42:59 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:42:59 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:42:59 user nova-compute[74870]:     </rng>
Nov 28 06:42:59 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:42:59 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:42:59 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:42:59 user nova-compute[74870]:     </memballoon>
Nov 28 06:42:59 user nova-compute[74870]:   </devices>
Nov 28 06:42:59 user nova-compute[74870]: </domain>
Nov 28 06:42:59 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:42:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance destroyed successfully.
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:42:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:c3:cb:4e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:43:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:00 user nova-compute[74870]: WARNING nova.compute.manager [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state active and task_state rescuing.
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:02 user nova-compute[74870]: WARNING nova.compute.manager [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state active and task_state rescuing.
Nov 28 06:43:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:02 user nova-compute[74870]: WARNING nova.compute.manager [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state active and task_state rescuing.
Nov 28 06:43:03 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:43:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:08 user nova-compute[74870]: INFO nova.compute.manager [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Rescuing
Nov 28 06:43:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:08 user nova-compute[74870]: DEBUG nova.network.neutron [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:43:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:09 user nova-compute[74870]: DEBUG nova.network.neutron [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating instance_info_cache with network_info: [{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:43:09 user nova-compute[74870]: INFO nova.compute.manager [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] instance snapshotting
Nov 28 06:43:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:10 user nova-compute[74870]: WARNING nova.compute.manager [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state active and task_state rescuing.
Nov 28 06:43:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Beginning live snapshot process
Nov 28 06:43:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance destroyed successfully.
Nov 28 06:43:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Attempting a stable device rescue
Nov 28 06:43:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:43:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Creating image(s)
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "/opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'trusted_certs' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "a2c8aee25d33c5322795cfee7c4beaa9da0689bb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "a2c8aee25d33c5322795cfee7c4beaa9da0689bb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.229s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcq6bem7j/92d6c49295d74ce7aa26435cfc8007d7.delta 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcq6bem7j/92d6c49295d74ce7aa26435cfc8007d7.delta 1073741824" returned: 0 in 1.034s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 06:43:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:12 user nova-compute[74870]: WARNING nova.compute.manager [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state active and task_state rescuing.
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.part --force-share --output=json" returned: 0 in 0.216s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG nova.virt.images [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] e28daa41-f99d-45da-991c-bc57eabaaf9a was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.part /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.part /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.converted" returned: 0 in 0.373s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "a2c8aee25d33c5322795cfee7c4beaa9da0689bb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.141s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "a2c8aee25d33c5322795cfee7c4beaa9da0689bb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "a2c8aee25d33c5322795cfee7c4beaa9da0689bb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb --force-share --output=json" returned: 0 in 0.346s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb,backing_fmt=raw /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb,backing_fmt=raw /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue" returned: 0 in 0.055s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "a2c8aee25d33c5322795cfee7c4beaa9da0689bb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.411s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'migration_context' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<eea1149f-7553-4beb-b8df-87822bd3abd5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Start _get_guest_xml network_info=[{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "vif_mac": "fa:16:3e:d5:81:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e28daa41-f99d-45da-991c-bc57eabaaf9a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'eea1149f-7553-4beb-b8df-87822bd3abd5', 'attached_at': '', 'detached_at': '', 'volume_id': '3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'serial': '3d2e80c8-217c-4493-967b-ecae0b6fe4e1'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '99a027cd-a110-43cb-98d8-a7bedce912ed', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'resources' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<eea1149f-7553-4beb-b8df-87822bd3abd5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'numa_topology' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<eea1149f-7553-4beb-b8df-87822bd3abd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:43:13 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:13 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'vcpu_model' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:43:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<eea1149f-7553-4beb-b8df-87822bd3abd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:43:13 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:43:13 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:43:13 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50027008-ae07-4374-8327-1311ae455ac8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DMnUjhmx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 06:43:13 user nova-compute[74870]: node.name = iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:43:13 user nova-compute[74870]: node.tpgt = -1
Nov 28 06:43:13 user nova-compute[74870]: node.startup = automatic
Nov 28 06:43:13 user nova-compute[74870]: node.leading_login = No
Nov 28 06:43:13 user nova-compute[74870]: iface.iscsi_ifacename = default
Nov 28 06:43:13 user nova-compute[74870]: iface.net_ifacename = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.ipaddress = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.prefix_len = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.hwaddress = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.transport_name = tcp
Nov 28 06:43:13 user nova-compute[74870]: iface.initiatorname = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.vlan_id = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.vlan_priority = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.vlan_state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.iface_num = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.mtu = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.port = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.bootproto = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.subnet_mask = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.gateway = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_alt_client_id = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_dns = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_learn_iqn = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_vendor_id_state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_vendor_id = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.dhcp_slp_da = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.fragmentation = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.gratuitous_arp = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.incoming_forwarding = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.tos_state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.tos = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.ttl = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.delayed_ack = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.tcp_nagle = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.tcp_wsf_state = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.tcp_wsf = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.tcp_timer_scale = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.tcp_timestamp = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.redirect = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.def_task_mgmt_timeout = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.header_digest = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.data_digest = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.immediate_data = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.initial_r2t = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.data_seq_inorder = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.data_pdu_inorder = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.erl = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.max_receive_data_len = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.first_burst_len = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.max_outstanding_r2t = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.max_burst_len = 0
Nov 28 06:43:13 user nova-compute[74870]: iface.chap_auth = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.bidi_chap = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.strict_login_compliance = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.discovery_auth = <empty>
Nov 28 06:43:13 user nova-compute[74870]: iface.discovery_logout = <empty>
Nov 28 06:43:13 user nova-compute[74870]: node.discovery_address = <empty>
Nov 28 06:43:13 user nova-compute[74870]: node.discovery_port = 0
Nov 28 06:43:13 user nova-compute[74870]: node.discovery_type = static
Nov 28 06:43:13 user nova-compute[74870]: node.session.initial_cmdsn = 0
Nov 28 06:43:13 user nova-compute[74870]: node.session.initial_login_retry_max = 8
Nov 28 06:43:13 user nova-compute[74870]: node.session.xmit_thread_priority = -20
Nov 28 06:43:13 user nova-compute[74870]: node.session.cmds_max = 128
Nov 28 06:43:13 user nova-compute[74870]: node.session.queue_depth = 32
Nov 28 06:43:13 user nova-compute[74870]: node.session.nr_sessions = 1
Nov 28 06:43:13 user nova-compute[74870]: node.session.auth.authmethod = CHAP
Nov 28 06:43:13 user nova-compute[74870]: node.session.auth.username = DMnUjhmx
Nov 28 06:43:13 user nova-compute[74870]: node.session.auth.password = ***
Nov 28 06:43:13 user nova-compute[74870]: node.session.auth.username_in = <empty>
Nov 28 06:43:13 user nova-compute[74870]: node.session.auth.password_in = <empty>
Nov 28 06:43:13 user nova-compute[74870]: node.session.auth.chap_algs = MD5
Nov 28 06:43:13 user nova-compute[74870]: node.session.timeo.replacement_timeout = 120
Nov 28 06:43:13 user nova-compute[74870]: node.session.err_timeo.abort_timeout = 15
Nov 28 06:43:13 user nova-compute[74870]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 06:43:13 user nova-compute[74870]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 06:43:13 user nova-compute[74870]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.FastAbort = Yes
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.InitialR2T = No
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.ImmediateData = Yes
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.MaxConnections = 1
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 06:43:13 user nova-compute[74870]: node.session.iscsi.ERL = 0
Nov 28 06:43:13 user nova-compute[74870]: node.session.scan = manual
Nov 28 06:43:13 user nova-compute[74870]: node.session.reopen_max = 0
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].address = 172.16.0.220
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].port = 3260
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].startup = manual
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].tcp.window_size = 524288
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].tcp.type_of_service = 0
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].timeo.logout_timeout = 15
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].timeo.login_timeout = 15
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].timeo.auth_timeout = 45
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].iscsi.DataDigest = None
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].iscsi.IFMarker = No
Nov 28 06:43:13 user nova-compute[74870]: node.conn[0].iscsi.OFMarker = No
Nov 28 06:43:13 user nova-compute[74870]: # END RECORD
Nov 28 06:43:13 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bd9176-164b-4451-98ab-e4b08211d9d5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcq6bem7j/92d6c49295d74ce7aa26435cfc8007d7.delta /opt/stack/data/nova/instances/snapshots/tmpcq6bem7j/92d6c49295d74ce7aa26435cfc8007d7 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1333d29-e267-4771-85ca-04885139a360]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMnUjhmx {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMnUjhmx" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[287df5c0-3fbc-4d0e-8c09-65fc6879bde5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMnUjhmx'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f55860-1e34-47b8-a40b-9eda94ca4bff]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84c469-faaf-48f7-9bd7-d63c9f7f0ce3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:43:13 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HCTL ('35', '0', '0', 0) found on session 14 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b044f2d7-5644-471b-ae0a-b62dabc8a07d]: (4, ('0 0 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching for a device in session 14 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.263s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== connect_volume: return (264ms) {'type': 'block', 'scsi_wwn': '26434363231306537', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434363231306537', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1924475466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1924475466',id=16,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-r9228def',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:41:42Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=eea1149f-7553-4beb-b8df-87822bd3abd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "vif_mac": "fa:16:3e:d5:81:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "vif_mac": "fa:16:3e:d5:81:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'pci_devices' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.objects.base [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<eea1149f-7553-4beb-b8df-87822bd3abd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:43:13 user nova-compute[74870]:   <uuid>eea1149f-7553-4beb-b8df-87822bd3abd5</uuid>
Nov 28 06:43:13 user nova-compute[74870]:   <name>instance-00000010</name>
Nov 28 06:43:13 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:43:13 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:43:13 user nova-compute[74870]:   <metadata>
Nov 28 06:43:13 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:43:13 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:43:13 user nova-compute[74870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1924475466</nova:name>
Nov 28 06:43:13 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:43:13</nova:creationTime>
Nov 28 06:43:13 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:43:13 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:43:13 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:43:13 user nova-compute[74870]:       <nova:owner>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:user uuid="c13b793a926942e88fc3416cf3fa005e">tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member</nova:user>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:project uuid="a07e9312175c4e73aa29a51865d61ebd">tempest-ServerBootFromVolumeStableRescueTest-397751332</nova:project>
Nov 28 06:43:13 user nova-compute[74870]:       </nova:owner>
Nov 28 06:43:13 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:43:13 user nova-compute[74870]:       <nova:ports>
Nov 28 06:43:13 user nova-compute[74870]:         <nova:port uuid="d2fa54ed-54c8-4e8f-8009-95df2712735d">
Nov 28 06:43:13 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 06:43:13 user nova-compute[74870]:         </nova:port>
Nov 28 06:43:13 user nova-compute[74870]:       </nova:ports>
Nov 28 06:43:13 user nova-compute[74870]:     </nova:instance>
Nov 28 06:43:13 user nova-compute[74870]:   </metadata>
Nov 28 06:43:13 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:43:13 user nova-compute[74870]:     <system>
Nov 28 06:43:13 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:43:13 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:43:13 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:43:13 user nova-compute[74870]:       <entry name="serial">eea1149f-7553-4beb-b8df-87822bd3abd5</entry>
Nov 28 06:43:13 user nova-compute[74870]:       <entry name="uuid">eea1149f-7553-4beb-b8df-87822bd3abd5</entry>
Nov 28 06:43:13 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:43:13 user nova-compute[74870]:     </system>
Nov 28 06:43:13 user nova-compute[74870]:   </sysinfo>
Nov 28 06:43:13 user nova-compute[74870]:   <os>
Nov 28 06:43:13 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:43:13 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:43:13 user nova-compute[74870]:   </os>
Nov 28 06:43:13 user nova-compute[74870]:   <features>
Nov 28 06:43:13 user nova-compute[74870]:     <acpi/>
Nov 28 06:43:13 user nova-compute[74870]:     <apic/>
Nov 28 06:43:13 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:43:13 user nova-compute[74870]:   </features>
Nov 28 06:43:13 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:43:13 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:43:13 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:43:13 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:43:13 user nova-compute[74870]:   </clock>
Nov 28 06:43:13 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:43:13 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:43:13 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:43:13 user nova-compute[74870]:   </cpu>
Nov 28 06:43:13 user nova-compute[74870]:   <devices>
Nov 28 06:43:13 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:43:13 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:43:13 user nova-compute[74870]:       <source dev="/dev/sdd"/>
Nov 28 06:43:13 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:43:13 user nova-compute[74870]:       <serial>3d2e80c8-217c-4493-967b-ecae0b6fe4e1</serial>
Nov 28 06:43:13 user nova-compute[74870]:     </disk>
Nov 28 06:43:13 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:43:13 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:43:13 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue"/>
Nov 28 06:43:13 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:43:13 user nova-compute[74870]:       <boot order="1"/>
Nov 28 06:43:13 user nova-compute[74870]:     </disk>
Nov 28 06:43:13 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:43:13 user nova-compute[74870]:       <mac address="fa:16:3e:d5:81:50"/>
Nov 28 06:43:13 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:13 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:43:13 user nova-compute[74870]:       <target dev="tapd2fa54ed-54"/>
Nov 28 06:43:13 user nova-compute[74870]:     </interface>
Nov 28 06:43:13 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:43:13 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/console.log" append="off"/>
Nov 28 06:43:13 user nova-compute[74870]:     </serial>
Nov 28 06:43:13 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:43:13 user nova-compute[74870]:     <video>
Nov 28 06:43:13 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:13 user nova-compute[74870]:     </video>
Nov 28 06:43:13 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:43:13 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:43:13 user nova-compute[74870]:     </rng>
Nov 28 06:43:13 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:43:13 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:43:13 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:43:13 user nova-compute[74870]:     </memballoon>
Nov 28 06:43:13 user nova-compute[74870]:   </devices>
Nov 28 06:43:13 user nova-compute[74870]: </domain>
Nov 28 06:43:13 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:43:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance destroyed successfully.
Nov 28 06:43:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No VIF found with MAC fa:16:3e:d5:81:50, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:43:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcq6bem7j/92d6c49295d74ce7aa26435cfc8007d7.delta /opt/stack/data/nova/instances/snapshots/tmpcq6bem7j/92d6c49295d74ce7aa26435cfc8007d7" returned: 0 in 0.510s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Snapshot extracted, beginning image upload
Nov 28 06:43:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:14 user nova-compute[74870]: INFO nova.compute.manager [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Detaching volume 53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:43:14 user nova-compute[74870]: INFO nova.virt.block_device [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Attempting to driver detach volume 53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 from mountpoint /dev/vdb
Nov 28 06:43:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Attempting to detach device vdb from instance b4802806-6422-46da-8d0f-5674af0a8433 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:43:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:43:14 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:43:14 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:43:14 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:43:14 user nova-compute[74870]:   <serial>53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2</serial>
Nov 28 06:43:14 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:43:14 user nova-compute[74870]: </disk>
Nov 28 06:43:14 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:43:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully detached device vdb from instance b4802806-6422-46da-8d0f-5674af0a8433 from the persistent domain config.
Nov 28 06:43:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4802806-6422-46da-8d0f-5674af0a8433 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:43:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:43:14 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:43:14 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:43:14 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:43:14 user nova-compute[74870]:   <serial>53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2</serial>
Nov 28 06:43:14 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:43:14 user nova-compute[74870]: </disk>
Nov 28 06:43:14 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:15 user nova-compute[74870]: WARNING nova.compute.manager [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state active and task_state rescuing.
Nov 28 06:43:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Snapshot image upload complete
Nov 28 06:43:16 user nova-compute[74870]: INFO nova.compute.manager [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Took 6.82 seconds to snapshot the instance on the hypervisor.
Nov 28 06:43:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:43:17 user nova-compute[74870]: INFO nova.compute.claims [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Claim successful on node user
Nov 28 06:43:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:17 user nova-compute[74870]: WARNING nova.compute.manager [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state active and task_state rescuing.
Nov 28 06:43:17 user nova-compute[74870]: DEBUG nova.compute.manager [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:43:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.policy [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3ace56f1264298944b8b765f51417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11f8db963684cba9927a06dfb035bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:43:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Creating image(s)
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "/opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "/opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "b948e4c678f976d97f0635ff49f7be7ec98d4fce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "b948e4c678f976d97f0635ff49f7be7ec98d4fce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG nova.virt.images [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 52b9b3f6-7ec4-4c22-9fff-9685a13fef92 was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.part /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.part /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.converted" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "b948e4c678f976d97f0635ff49f7be7ec98d4fce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.957s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:43:19 user nova-compute[74870]: INFO nova.compute.claims [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Claim successful on node user
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce --force-share --output=json" returned: 0 in 0.221s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "b948e4c678f976d97f0635ff49f7be7ec98d4fce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "b948e4c678f976d97f0635ff49f7be7ec98d4fce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce,backing_fmt=raw /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce,backing_fmt=raw /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk 1073741824" returned: 0 in 0.047s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "b948e4c678f976d97f0635ff49f7be7ec98d4fce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Successfully created port: ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Cannot resize image /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Ensure instance console log exists: /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.833s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:43:20 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.policy [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:43:20 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Creating image(s)
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "/opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "/opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "/opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "05803b2bea107ddc79145e4db15684ca3d2e84c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "05803b2bea107ddc79145e4db15684ca3d2e84c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Successfully updated port: ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Successfully created port: 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-changed-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Refreshing instance network info cache due to event network-changed-ea9497df-2959-489f-a6d7-4ce7a474741d. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Acquiring lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Acquired lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Refreshing network info cache for port ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.part --force-share --output=json" returned: 0 in 0.231s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.virt.images [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] a909e0d0-4869-4e36-a872-7b376b6589c3 was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.part /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Releasing lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquired lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.part /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.converted" returned: 0 in 0.265s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "05803b2bea107ddc79145e4db15684ca3d2e84c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.698s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Successfully updated port: 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Updating instance_info_cache with network_info: [{"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquired lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "05803b2bea107ddc79145e4db15684ca3d2e84c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "05803b2bea107ddc79145e4db15684ca3d2e84c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Releasing lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Instance network_info: |[{"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Start _get_guest_xml network_info=[{"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:43:12Z,direct_url=<?>,disk_format='qcow2',id=52b9b3f6-7ec4-4c22-9fff-9685a13fef92,min_disk=0,min_ram=0,name='',owner='2212bc9647614854acbfa4fb6e3cfeb7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:43:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'image_id': '52b9b3f6-7ec4-4c22-9fff-9685a13fef92'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:43:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-changed-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Refreshing instance network info cache due to event network-changed-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Acquiring lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:43:12Z,direct_url=<?>,disk_format='qcow2',id=52b9b3f6-7ec4-4c22-9fff-9685a13fef92,min_disk=0,min_ram=0,name='',owner='2212bc9647614854acbfa4fb6e3cfeb7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:43:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2105331009',display_name='tempest-AttachSCSIVolumeTestJSON-server-2105331009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2105331009',id=19,image_ref='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIVLH1EMKjoa8/5idYsoqJ/Gd6qA/lgnXxioHq5yn0go7DEbTlnSQHYoZwO2InVEgB69dENX4prOHb5gFHZNz2jR3GGDYquPPt0HIfVcbrMHKnsWuf698tJWffDPd9nCg==',key_name='tempest-keypair-1058119261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f11f8db963684cba9927a06dfb035bd3',ramdisk_id='',reservation_id='r-cwch0tpj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-952007140',owner_user_name='tempest-AttachSCSIVolumeTestJSON-952007140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3ace56f1264298944b8b765f51417f',uuid=9ec477b1-ae4b-4ec0-b396-353c82f38972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Converting VIF {"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:43:22 user nova-compute[74870]:   <uuid>9ec477b1-ae4b-4ec0-b396-353c82f38972</uuid>
Nov 28 06:43:22 user nova-compute[74870]:   <name>instance-00000013</name>
Nov 28 06:43:22 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:43:22 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:43:22 user nova-compute[74870]:   <metadata>
Nov 28 06:43:22 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:43:22 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:43:22 user nova-compute[74870]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2105331009</nova:name>
Nov 28 06:43:22 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:43:22</nova:creationTime>
Nov 28 06:43:22 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:43:22 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:43:22 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:43:22 user nova-compute[74870]:       <nova:owner>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:user uuid="3b3ace56f1264298944b8b765f51417f">tempest-AttachSCSIVolumeTestJSON-952007140-project-member</nova:user>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:project uuid="f11f8db963684cba9927a06dfb035bd3">tempest-AttachSCSIVolumeTestJSON-952007140</nova:project>
Nov 28 06:43:22 user nova-compute[74870]:       </nova:owner>
Nov 28 06:43:22 user nova-compute[74870]:       <nova:root type="image" uuid="52b9b3f6-7ec4-4c22-9fff-9685a13fef92"/>
Nov 28 06:43:22 user nova-compute[74870]:       <nova:ports>
Nov 28 06:43:22 user nova-compute[74870]:         <nova:port uuid="ea9497df-2959-489f-a6d7-4ce7a474741d">
Nov 28 06:43:22 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:43:22 user nova-compute[74870]:         </nova:port>
Nov 28 06:43:22 user nova-compute[74870]:       </nova:ports>
Nov 28 06:43:22 user nova-compute[74870]:     </nova:instance>
Nov 28 06:43:22 user nova-compute[74870]:   </metadata>
Nov 28 06:43:22 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:43:22 user nova-compute[74870]:     <system>
Nov 28 06:43:22 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:43:22 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:43:22 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:43:22 user nova-compute[74870]:       <entry name="serial">9ec477b1-ae4b-4ec0-b396-353c82f38972</entry>
Nov 28 06:43:22 user nova-compute[74870]:       <entry name="uuid">9ec477b1-ae4b-4ec0-b396-353c82f38972</entry>
Nov 28 06:43:22 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:43:22 user nova-compute[74870]:     </system>
Nov 28 06:43:22 user nova-compute[74870]:   </sysinfo>
Nov 28 06:43:22 user nova-compute[74870]:   <os>
Nov 28 06:43:22 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:43:22 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:43:22 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:43:22 user nova-compute[74870]:   </os>
Nov 28 06:43:22 user nova-compute[74870]:   <features>
Nov 28 06:43:22 user nova-compute[74870]:     <acpi/>
Nov 28 06:43:22 user nova-compute[74870]:     <apic/>
Nov 28 06:43:22 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:43:22 user nova-compute[74870]:   </features>
Nov 28 06:43:22 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:43:22 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:43:22 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:43:22 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:43:22 user nova-compute[74870]:   </clock>
Nov 28 06:43:22 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:43:22 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:43:22 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:43:22 user nova-compute[74870]:   </cpu>
Nov 28 06:43:22 user nova-compute[74870]:   <devices>
Nov 28 06:43:22 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:43:22 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:43:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk"/>
Nov 28 06:43:22 user nova-compute[74870]:       <target dev="sda" bus="scsi"/>
Nov 28 06:43:22 user nova-compute[74870]:       <address type="drive" controller="0" unit="0"/>
Nov 28 06:43:22 user nova-compute[74870]:     </disk>
Nov 28 06:43:22 user nova-compute[74870]:     <disk type="file" device="cdrom">
Nov 28 06:43:22 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 06:43:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.config"/>
Nov 28 06:43:22 user nova-compute[74870]:       <target dev="sdb" bus="scsi"/>
Nov 28 06:43:22 user nova-compute[74870]:       <address type="drive" controller="0" unit="1"/>
Nov 28 06:43:22 user nova-compute[74870]:     </disk>
Nov 28 06:43:22 user nova-compute[74870]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 06:43:22 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:43:22 user nova-compute[74870]:       <mac address="fa:16:3e:3a:e5:1f"/>
Nov 28 06:43:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:22 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:43:22 user nova-compute[74870]:       <target dev="tapea9497df-29"/>
Nov 28 06:43:22 user nova-compute[74870]:     </interface>
Nov 28 06:43:22 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:43:22 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/console.log" append="off"/>
Nov 28 06:43:22 user nova-compute[74870]:     </serial>
Nov 28 06:43:22 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:43:22 user nova-compute[74870]:     <video>
Nov 28 06:43:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:22 user nova-compute[74870]:     </video>
Nov 28 06:43:22 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:43:22 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:43:22 user nova-compute[74870]:     </rng>
Nov 28 06:43:22 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:43:22 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:43:22 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:43:22 user nova-compute[74870]:     </memballoon>
Nov 28 06:43:22 user nova-compute[74870]:   </devices>
Nov 28 06:43:22 user nova-compute[74870]: </domain>
Nov 28 06:43:22 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2105331009',display_name='tempest-AttachSCSIVolumeTestJSON-server-2105331009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2105331009',id=19,image_ref='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIVLH1EMKjoa8/5idYsoqJ/Gd6qA/lgnXxioHq5yn0go7DEbTlnSQHYoZwO2InVEgB69dENX4prOHb5gFHZNz2jR3GGDYquPPt0HIfVcbrMHKnsWuf698tJWffDPd9nCg==',key_name='tempest-keypair-1058119261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f11f8db963684cba9927a06dfb035bd3',ramdisk_id='',reservation_id='r-cwch0tpj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-952007140',owner_user_name='tempest-AttachSCSIVolumeTestJSON-952007140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3ace56f1264298944b8b765f51417f',uuid=9ec477b1-ae4b-4ec0-b396-353c82f38972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Converting VIF {"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG os_vif [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '650c7659-cfe8-53bc-81e2-ca7c7a55525c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea9497df-29, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea9497df-29, col_values=(('qos', UUID('ec23e57f-d68d-421b-92db-225cb6325bcb')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea9497df-29, col_values=(('external_ids', {'iface-id': 'ea9497df-2959-489f-a6d7-4ce7a474741d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:e5:1f', 'vm-uuid': '9ec477b1-ae4b-4ec0-b396-353c82f38972'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:22 user nova-compute[74870]: INFO os_vif [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29')
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 --force-share --output=json" returned: 0 in 0.243s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8,backing_fmt=raw /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8,backing_fmt=raw /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk 1073741824" returned: 0 in 0.060s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "05803b2bea107ddc79145e4db15684ca3d2e84c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No BDM found with device name sda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:43:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No VIF found with MAC fa:16:3e:3a:e5:1f, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:43:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Using config drive
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Ensure instance console log exists: /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updating instance_info_cache with network_info: [{"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Releasing lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Instance network_info: |[{"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Acquired lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Refreshing network info cache for port 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Start _get_guest_xml network_info=[{"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='89e86e2bd2b3c99969545d88e903386e',container_format='bare',created_at=2023-11-28T06:43:10Z,direct_url=<?>,disk_format='qcow2',id=a909e0d0-4869-4e36-a872-7b376b6589c3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-942014689',owner='48cff8da56da484d9dfee1b8118474b9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T06:43:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'a909e0d0-4869-4e36-a872-7b376b6589c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:43:23 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:23 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='89e86e2bd2b3c99969545d88e903386e',container_format='bare',created_at=2023-11-28T06:43:10Z,direct_url=<?>,disk_format='qcow2',id=a909e0d0-4869-4e36-a872-7b376b6589c3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-942014689',owner='48cff8da56da484d9dfee1b8118474b9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T06:43:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-835941228',display_name='tempest-TestStampPattern-server-835941228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-835941228',id=20,image_ref='a909e0d0-4869-4e36-a872-7b376b6589c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A==',key_name='tempest-TestStampPattern-1173073735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48cff8da56da484d9dfee1b8118474b9',ramdisk_id='',reservation_id='r-mdg76erv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5',image_min_disk='1',image_min_ram='0',image_owner_id='48cff8da56da484d9dfee1b8118474b9',image_owner_project_name='tempest-TestStampPattern-415121645',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-415121645-project-member',image_user_id='73373ee05e1b4e09b5c0870750a77262',network_allocated='True',owner_project_name='tempest-TestStampPattern-415121645',owner_user_name='tempest-TestStampPattern-415121645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:43:21Z,user_data=None,user_id='73373ee05e1b4e09b5c0870750a77262',uuid=77393c2a-5fb1-48ec-88bd-a13fc6f39f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converting VIF {"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'pci_devices' on Instance uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Creating config drive at /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.config
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp45jem3op {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:43:23 user nova-compute[74870]:   <uuid>77393c2a-5fb1-48ec-88bd-a13fc6f39f3c</uuid>
Nov 28 06:43:23 user nova-compute[74870]:   <name>instance-00000014</name>
Nov 28 06:43:23 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:43:23 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:43:23 user nova-compute[74870]:   <metadata>
Nov 28 06:43:23 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:43:23 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:43:23 user nova-compute[74870]:       <nova:name>tempest-TestStampPattern-server-835941228</nova:name>
Nov 28 06:43:23 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:43:23</nova:creationTime>
Nov 28 06:43:23 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:43:23 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:43:23 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:43:23 user nova-compute[74870]:       <nova:owner>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:user uuid="73373ee05e1b4e09b5c0870750a77262">tempest-TestStampPattern-415121645-project-member</nova:user>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:project uuid="48cff8da56da484d9dfee1b8118474b9">tempest-TestStampPattern-415121645</nova:project>
Nov 28 06:43:23 user nova-compute[74870]:       </nova:owner>
Nov 28 06:43:23 user nova-compute[74870]:       <nova:root type="image" uuid="a909e0d0-4869-4e36-a872-7b376b6589c3"/>
Nov 28 06:43:23 user nova-compute[74870]:       <nova:ports>
Nov 28 06:43:23 user nova-compute[74870]:         <nova:port uuid="4c2e30a2-39fb-43e0-bcea-6a752bc5a76b">
Nov 28 06:43:23 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 06:43:23 user nova-compute[74870]:         </nova:port>
Nov 28 06:43:23 user nova-compute[74870]:       </nova:ports>
Nov 28 06:43:23 user nova-compute[74870]:     </nova:instance>
Nov 28 06:43:23 user nova-compute[74870]:   </metadata>
Nov 28 06:43:23 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:43:23 user nova-compute[74870]:     <system>
Nov 28 06:43:23 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:43:23 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:43:23 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:43:23 user nova-compute[74870]:       <entry name="serial">77393c2a-5fb1-48ec-88bd-a13fc6f39f3c</entry>
Nov 28 06:43:23 user nova-compute[74870]:       <entry name="uuid">77393c2a-5fb1-48ec-88bd-a13fc6f39f3c</entry>
Nov 28 06:43:23 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:43:23 user nova-compute[74870]:     </system>
Nov 28 06:43:23 user nova-compute[74870]:   </sysinfo>
Nov 28 06:43:23 user nova-compute[74870]:   <os>
Nov 28 06:43:23 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:43:23 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:43:23 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:43:23 user nova-compute[74870]:   </os>
Nov 28 06:43:23 user nova-compute[74870]:   <features>
Nov 28 06:43:23 user nova-compute[74870]:     <acpi/>
Nov 28 06:43:23 user nova-compute[74870]:     <apic/>
Nov 28 06:43:23 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:43:23 user nova-compute[74870]:   </features>
Nov 28 06:43:23 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:43:23 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:43:23 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:43:23 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:43:23 user nova-compute[74870]:   </clock>
Nov 28 06:43:23 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:43:23 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:43:23 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:43:23 user nova-compute[74870]:   </cpu>
Nov 28 06:43:23 user nova-compute[74870]:   <devices>
Nov 28 06:43:23 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:43:23 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:43:23 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk"/>
Nov 28 06:43:23 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:43:23 user nova-compute[74870]:     </disk>
Nov 28 06:43:23 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:43:23 user nova-compute[74870]:       <mac address="fa:16:3e:e0:75:70"/>
Nov 28 06:43:23 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:23 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:43:23 user nova-compute[74870]:       <target dev="tap4c2e30a2-39"/>
Nov 28 06:43:23 user nova-compute[74870]:     </interface>
Nov 28 06:43:23 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:43:23 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/console.log" append="off"/>
Nov 28 06:43:23 user nova-compute[74870]:     </serial>
Nov 28 06:43:23 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:43:23 user nova-compute[74870]:     <video>
Nov 28 06:43:23 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:23 user nova-compute[74870]:     </video>
Nov 28 06:43:23 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:43:23 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:43:23 user nova-compute[74870]:     </rng>
Nov 28 06:43:23 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:43:23 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:43:23 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:43:23 user nova-compute[74870]:     </memballoon>
Nov 28 06:43:23 user nova-compute[74870]:   </devices>
Nov 28 06:43:23 user nova-compute[74870]: </domain>
Nov 28 06:43:23 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-835941228',display_name='tempest-TestStampPattern-server-835941228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-835941228',id=20,image_ref='a909e0d0-4869-4e36-a872-7b376b6589c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A==',key_name='tempest-TestStampPattern-1173073735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48cff8da56da484d9dfee1b8118474b9',ramdisk_id='',reservation_id='r-mdg76erv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5',image_min_disk='1',image_min_ram='0',image_owner_id='48cff8da56da484d9dfee1b8118474b9',image_owner_project_name='tempest-TestStampPattern-415121645',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-415121645-project-member',image_user_id='73373ee05e1b4e09b5c0870750a77262',network_allocated='True',owner_project_name='tempest-TestStampPattern-415121645',owner_user_name='tempest-TestStampPattern-415121645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:43:21Z,user_data=None,user_id='73373ee05e1b4e09b5c0870750a77262',uuid=77393c2a-5fb1-48ec-88bd-a13fc6f39f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converting VIF {"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG os_vif [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9c99a0e-701b-5fc0-8562-16d013abd400', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp45jem3op" returned: 0 in 0.087s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c2e30a2-39, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c2e30a2-39, col_values=(('qos', UUID('b0b3254d-6139-4eb5-8861-bafc16245d24')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c2e30a2-39, col_values=(('external_ids', {'iface-id': '4c2e30a2-39fb-43e0-bcea-6a752bc5a76b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:75:70', 'vm-uuid': '77393c2a-5fb1-48ec-88bd-a13fc6f39f3c'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:23 user nova-compute[74870]: INFO os_vif [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39')
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No VIF found with MAC fa:16:3e:e0:75:70, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updated VIF entry in instance network info cache for port 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updating instance_info_cache with network_info: [{"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Releasing lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] No waiting events found dispatching network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:26 user nova-compute[74870]: WARNING nova.compute.manager [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received unexpected event network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d for instance with vm_state building and task_state spawning.
Nov 28 06:43:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] No waiting events found dispatching network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:26 user nova-compute[74870]: WARNING nova.compute.manager [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received unexpected event network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance with vm_state building and task_state spawning.
Nov 28 06:43:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] No waiting events found dispatching network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:28 user nova-compute[74870]: WARNING nova.compute.manager [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received unexpected event network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d for instance with vm_state building and task_state spawning.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] No waiting events found dispatching network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:28 user nova-compute[74870]: WARNING nova.compute.manager [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received unexpected event network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance with vm_state building and task_state spawning.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:43:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Instance spawned successfully.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:43:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Instance spawned successfully.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:28 user nova-compute[74870]: INFO nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Took 10.22 seconds to spawn the instance on the hypervisor.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:43:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:28 user nova-compute[74870]: INFO nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Took 8.11 seconds to spawn the instance on the hypervisor.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:43:28 user nova-compute[74870]: INFO nova.compute.manager [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Took 11.37 seconds to build instance.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.486s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:28 user nova-compute[74870]: INFO nova.compute.manager [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Took 9.40 seconds to build instance.
Nov 28 06:43:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.561s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:34 user nova-compute[74870]: INFO nova.compute.manager [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Terminating instance
Nov 28 06:43:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-vif-unplugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] No waiting events found dispatching network-vif-unplugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-vif-unplugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updating instance_info_cache with network_info: [{"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-b4802806-6422-46da-8d0f-5674af0a8433" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:43:35 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b4802806-6422-46da-8d0f-5674af0a8433 is timed out.
Nov 28 06:43:35 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully detached device vdb from instance b4802806-6422-46da-8d0f-5674af0a8433 from the live domain config.
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRlUZyJL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:43:35 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c5cd1a-05e6-4e68-8e2a-86b503adcd7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:43:35 user nova-compute[74870]: No targets found.
Nov 28 06:43:35 user nova-compute[74870]: iSNS:
Nov 28 06:43:35 user nova-compute[74870]: No targets found.
Nov 28 06:43:35 user nova-compute[74870]: STATIC:
Nov 28 06:43:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2
Nov 28 06:43:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:43:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:43:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:43:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:43:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:43:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:43:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:43:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:43:35 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:43:35 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:43:35 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:43:35 user nova-compute[74870]: FIRMWARE:
Nov 28 06:43:35 user nova-compute[74870]: No targets found.
Nov 28 06:43:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:43:35 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:43:35 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedfac7e-0865-4341-8a4a-48965e69ff0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b79566-e537-49b1-861a-065ed197d0fb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 (non-flash)
Nov 28 06:43:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7f3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2'): ({'sdf'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Removing single pathed devices sdf {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba806b-92a8-478a-9dc6-9aef75d42fa0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef2088f-3088-4b15-aa5f-6cbacdafebad]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flushing IO for device /dev/sdf {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5813ba70-514f-4d62-a8e0-76ad7e0f03a6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[474de7eb-d1f9-44d2-9e59-c0f3c726948b]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Instance destroyed successfully.
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'resources' on Instance uuid 93f30c00-ea3c-445c-b0c9-5ef899412580 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-759299404',display_name='tempest-VolumesAdminNegativeTest-server-759299404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-759299404',id=17,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c265a98d205f4b679d3a810b4745691a',ramdisk_id='',reservation_id='r-e47aurbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1747870246',owner_user_name='tempest-VolumesAdminNegativeTest-1747870246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:41:45Z,user_data=None,user_id='3e8b23eae758490a8a2476797479f208',uuid=93f30c00-ea3c-445c-b0c9-5ef899412580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converting VIF {"id": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "address": "fa:16:3e:f1:e8:11", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc3fcfe-30", "ovs_interfaceid": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_vif [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cc3fcfe-30, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba0fcfa-4acf-400d-b2f3-62a797030301]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae1fd479-c5ed-4e8b-9a7f-1a46d1d02876) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:35 user nova-compute[74870]: INFO os_vif [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e8:11,bridge_name='br-int',has_traffic_filtering=True,id=1cc3fcfe-307b-49f6-bb59-b8b33aa7764a,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc3fcfe-30')
Nov 28 06:43:35 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Deleting instance files /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580_del
Nov 28 06:43:35 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Deletion of /opt/stack/data/nova/instances/93f30c00-ea3c-445c-b0c9-5ef899412580_del complete
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e9a7e6-cac2-4f6c-bd8c-f1cbed81d804]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260]
Nov 28 06:43:35 user nova-compute[74870]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2, portal: 172.16.0.220,3260] successful.
Nov 28 06:43:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d73b55f-3d4c-4228-a564-33e3209d220e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== disconnect_volume: return (404ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:43:35 user nova-compute[74870]: INFO nova.compute.manager [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:36 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Took 0.72 seconds to deallocate network for instance.
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.338s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Acquiring lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] No waiting events found dispatching network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:37 user nova-compute[74870]: WARNING nova.compute.manager [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received unexpected event network-vif-plugged-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance with vm_state deleted and task_state None.
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Received event network-vif-deleted-1cc3fcfe-307b-49f6-bb59-b8b33aa7764a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.751s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:37 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Deleted allocations for instance 93f30c00-ea3c-445c-b0c9-5ef899412580
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "93f30c00-ea3c-445c-b0c9-5ef899412580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.670s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:43:37 user nova-compute[74870]: INFO nova.compute.claims [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Claim successful on node user
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:37 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '93f30c00-ea3c-445c-b0c9-5ef899412580' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '93f30c00-ea3c-445c-b0c9-5ef899412580' (instance-00000011)
Nov 28 06:43:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:43:38 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.policy [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65a520d2b45446098b6b97532a696bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4536fef53e47e4aac07b82ff452fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:43:38 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Creating image(s)
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "/opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "/opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "/opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk 1073741824" returned: 0 in 0.051s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Successfully created port: 6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Cannot resize image /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Ensure instance console log exists: /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Successfully updated port: 6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "refresh_cache-25781b03-ef60-44cd-aab8-5f5b3350b8fd" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquired lock "refresh_cache-25781b03-ef60-44cd-aab8-5f5b3350b8fd" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-changed-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Refreshing instance network info cache due to event network-changed-6e4a143d-6a3f-45dc-955f-f6be6c3918ae. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Acquiring lock "refresh_cache-25781b03-ef60-44cd-aab8-5f5b3350b8fd" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:43:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Updating instance_info_cache with network_info: [{"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Releasing lock "refresh_cache-25781b03-ef60-44cd-aab8-5f5b3350b8fd" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Instance network_info: |[{"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Acquired lock "refresh_cache-25781b03-ef60-44cd-aab8-5f5b3350b8fd" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Refreshing network info cache for port 6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Start _get_guest_xml network_info=[{"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-254217302',display_name='tempest-DeleteServersTestJSON-server-254217302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-254217302',id=21,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa4536fef53e47e4aac07b82ff452fd6',ramdisk_id='',reservation_id='r-0jc80md3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1238418010',owner_user_name='tempest-DeleteServersTestJSON-1238418010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:43:38Z,user_data=None,user_id='65a520d2b45446098b6b97532a696bd8',uuid=25781b03-ef60-44cd-aab8-5f5b3350b8fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Converting VIF {"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lazy-loading 'pci_devices' on Instance uuid 25781b03-ef60-44cd-aab8-5f5b3350b8fd {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:43:40 user nova-compute[74870]:   <uuid>25781b03-ef60-44cd-aab8-5f5b3350b8fd</uuid>
Nov 28 06:43:40 user nova-compute[74870]:   <name>instance-00000015</name>
Nov 28 06:43:40 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:43:40 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:43:40 user nova-compute[74870]:   <metadata>
Nov 28 06:43:40 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:43:40 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:43:40 user nova-compute[74870]:       <nova:name>tempest-DeleteServersTestJSON-server-254217302</nova:name>
Nov 28 06:43:40 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:43:40</nova:creationTime>
Nov 28 06:43:40 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:43:40 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:43:40 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:43:40 user nova-compute[74870]:       <nova:owner>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:user uuid="65a520d2b45446098b6b97532a696bd8">tempest-DeleteServersTestJSON-1238418010-project-member</nova:user>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:project uuid="aa4536fef53e47e4aac07b82ff452fd6">tempest-DeleteServersTestJSON-1238418010</nova:project>
Nov 28 06:43:40 user nova-compute[74870]:       </nova:owner>
Nov 28 06:43:40 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:43:40 user nova-compute[74870]:       <nova:ports>
Nov 28 06:43:40 user nova-compute[74870]:         <nova:port uuid="6e4a143d-6a3f-45dc-955f-f6be6c3918ae">
Nov 28 06:43:40 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 06:43:40 user nova-compute[74870]:         </nova:port>
Nov 28 06:43:40 user nova-compute[74870]:       </nova:ports>
Nov 28 06:43:40 user nova-compute[74870]:     </nova:instance>
Nov 28 06:43:40 user nova-compute[74870]:   </metadata>
Nov 28 06:43:40 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:43:40 user nova-compute[74870]:     <system>
Nov 28 06:43:40 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:43:40 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:43:40 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:43:40 user nova-compute[74870]:       <entry name="serial">25781b03-ef60-44cd-aab8-5f5b3350b8fd</entry>
Nov 28 06:43:40 user nova-compute[74870]:       <entry name="uuid">25781b03-ef60-44cd-aab8-5f5b3350b8fd</entry>
Nov 28 06:43:40 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:43:40 user nova-compute[74870]:     </system>
Nov 28 06:43:40 user nova-compute[74870]:   </sysinfo>
Nov 28 06:43:40 user nova-compute[74870]:   <os>
Nov 28 06:43:40 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:43:40 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:43:40 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:43:40 user nova-compute[74870]:   </os>
Nov 28 06:43:40 user nova-compute[74870]:   <features>
Nov 28 06:43:40 user nova-compute[74870]:     <acpi/>
Nov 28 06:43:40 user nova-compute[74870]:     <apic/>
Nov 28 06:43:40 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:43:40 user nova-compute[74870]:   </features>
Nov 28 06:43:40 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:43:40 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:43:40 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:43:40 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:43:40 user nova-compute[74870]:   </clock>
Nov 28 06:43:40 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:43:40 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:43:40 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:43:40 user nova-compute[74870]:   </cpu>
Nov 28 06:43:40 user nova-compute[74870]:   <devices>
Nov 28 06:43:40 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:43:40 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:43:40 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk"/>
Nov 28 06:43:40 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:43:40 user nova-compute[74870]:     </disk>
Nov 28 06:43:40 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:43:40 user nova-compute[74870]:       <mac address="fa:16:3e:02:16:b7"/>
Nov 28 06:43:40 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:40 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:43:40 user nova-compute[74870]:       <target dev="tap6e4a143d-6a"/>
Nov 28 06:43:40 user nova-compute[74870]:     </interface>
Nov 28 06:43:40 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:43:40 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/console.log" append="off"/>
Nov 28 06:43:40 user nova-compute[74870]:     </serial>
Nov 28 06:43:40 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:43:40 user nova-compute[74870]:     <video>
Nov 28 06:43:40 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:43:40 user nova-compute[74870]:     </video>
Nov 28 06:43:40 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:43:40 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:43:40 user nova-compute[74870]:     </rng>
Nov 28 06:43:40 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:43:40 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:43:40 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:43:40 user nova-compute[74870]:     </memballoon>
Nov 28 06:43:40 user nova-compute[74870]:   </devices>
Nov 28 06:43:40 user nova-compute[74870]: </domain>
Nov 28 06:43:40 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-254217302',display_name='tempest-DeleteServersTestJSON-server-254217302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-254217302',id=21,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa4536fef53e47e4aac07b82ff452fd6',ramdisk_id='',reservation_id='r-0jc80md3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1238418010',owner_user_name='tempest-DeleteServersTestJSON-1238418010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:43:38Z,user_data=None,user_id='65a520d2b45446098b6b97532a696bd8',uuid=25781b03-ef60-44cd-aab8-5f5b3350b8fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Converting VIF {"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG os_vif [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8210f4d1-7e09-50ef-8e20-d3ad750bdf43', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e4a143d-6a, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e4a143d-6a, col_values=(('qos', UUID('6655e588-9ea7-479d-94a4-bca97880c2ef')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e4a143d-6a, col_values=(('external_ids', {'iface-id': '6e4a143d-6a3f-45dc-955f-f6be6c3918ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:16:b7', 'vm-uuid': '25781b03-ef60-44cd-aab8-5f5b3350b8fd'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:40 user nova-compute[74870]: INFO os_vif [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a')
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] No VIF found with MAC fa:16:3e:02:16:b7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Updated VIF entry in instance network info cache for port 6e4a143d-6a3f-45dc-955f-f6be6c3918ae. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Updating instance_info_cache with network_info: [{"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Releasing lock "refresh_cache-25781b03-ef60-44cd-aab8-5f5b3350b8fd" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] No waiting events found dispatching network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:42 user nova-compute[74870]: WARNING nova.compute.manager [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received unexpected event network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance with vm_state building and task_state spawning.
Nov 28 06:43:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] No waiting events found dispatching network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:43:45 user nova-compute[74870]: WARNING nova.compute.manager [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received unexpected event network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance with vm_state building and task_state spawning.
Nov 28 06:43:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Instance spawned successfully.
Nov 28 06:43:45 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:45 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7105MB free_disk=25.08383560180664GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Applying migration context for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 as it has an incoming, in-progress migration 6566d01b-b539-4af6-bfe6-db894c82f82a. Migration status is finished {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 06:43:45 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating resource usage from migration 6566d01b-b539-4af6-bfe6-db894c82f82a
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance b4802806-6422-46da-8d0f-5674af0a8433 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Migration 6566d01b-b539-4af6-bfe6-db894c82f82a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:43:45 user nova-compute[74870]: INFO nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:45 user nova-compute[74870]: INFO nova.compute.manager [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Took 8.11 seconds to build instance.
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.214s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:43:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:43:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:43:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 06:44:05 user nova-compute[74870]: INFO nova.compute.manager [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Terminating instance
Nov 28 06:44:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-vif-unplugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] No waiting events found dispatching network-vif-unplugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-vif-unplugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:44:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Instance destroyed successfully.
Nov 28 06:44:06 user nova-compute[74870]: DEBUG nova.objects.instance [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'resources' on Instance uuid b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1388737861',display_name='tempest-AttachVolumeNegativeTest-server-1388737861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1388737861',id=5,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqYtsHqlq6UKTcER/k64lfbXh2pA9vJqnA4e6c2hp60qQnuBhq6XBV/hxrGLANQCI7nGeXEsElJ+UTUn1LBk09Vnw0+lDPP3HxcBU8qrbayCFVs/OVYsCYO8uUsYj85OA==',key_name='tempest-keypair-894833367',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-3mjoe57e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=b4802806-6422-46da-8d0f-5674af0a8433,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "address": "fa:16:3e:1b:24:e7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2f08f7-ca", "ovs_interfaceid": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG os_vif [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a2f08f7-ca, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f7ff85f-85d1-4d81-9486-c9054a636fd2) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:44:06 user nova-compute[74870]: INFO os_vif [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:24:e7,bridge_name='br-int',has_traffic_filtering=True,id=1a2f08f7-ca07-4148-a3d9-a9034157bd6a,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2f08f7-ca')
Nov 28 06:44:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Deleting instance files /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433_del
Nov 28 06:44:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Deletion of /opt/stack/data/nova/instances/b4802806-6422-46da-8d0f-5674af0a8433_del complete
Nov 28 06:44:06 user nova-compute[74870]: INFO nova.compute.manager [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 06:44:06 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:44:06 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: b4802806-6422-46da-8d0f-5674af0a8433] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:07 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Took 1.03 seconds to deallocate network for instance.
Nov 28 06:44:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-vif-deleted-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received event network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Acquiring lock "b4802806-6422-46da-8d0f-5674af0a8433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Lock "b4802806-6422-46da-8d0f-5674af0a8433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] No waiting events found dispatching network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:07 user nova-compute[74870]: WARNING nova.compute.manager [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Received unexpected event network-vif-plugged-1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance with vm_state deleted and task_state None.
Nov 28 06:44:07 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:07 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Deleted allocations for instance b4802806-6422-46da-8d0f-5674af0a8433
Nov 28 06:44:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "b4802806-6422-46da-8d0f-5674af0a8433" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.941s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:09 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Port 717f616f-b485-4c7e-83be-a80086c19692 binding to destination host user is already ACTIVE {{(pid=74870) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Creating tmpfile /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/tmppnx6dg0k to verify with other compute node that the instance is on the same shared storage. {{(pid=74870) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-unplugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-unplugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:10 user nova-compute[74870]: WARNING nova.compute.manager [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-unplugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state resized and task_state resize_reverting.
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance destroyed successfully.
Nov 28 06:44:11 user nova-compute[74870]: DEBUG nova.objects.instance [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'resources' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717f616f-b4, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e77f8fb8-aca7-44cc-a456-ee85e3f780de) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:44:11 user nova-compute[74870]: INFO os_vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4')
Nov 28 06:44:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:44:11 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a36c3-4045-4e19-b558-925bf62f073f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:44:11 user nova-compute[74870]: No targets found.
Nov 28 06:44:11 user nova-compute[74870]: iSNS:
Nov 28 06:44:11 user nova-compute[74870]: No targets found.
Nov 28 06:44:11 user nova-compute[74870]: STATIC:
Nov 28 06:44:11 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:44:11 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:44:11 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:44:11 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:44:11 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:44:11 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:44:11 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:44:11 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:44:11 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:44:11 user nova-compute[74870]: FIRMWARE:
Nov 28 06:44:11 user nova-compute[74870]: No targets found.
Nov 28 06:44:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:44:11 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:44:11 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c8415e-73fe-43a6-96e0-8ffedd0375b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b144088a-2658-47d1-be7a-d132d49ead62]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:44:11 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:44:11 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:44:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:44:11 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:44:11 user nova-compute[74870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:44:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc468940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf7f69b-302b-43b8-abad-fc22b2347928]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd6cf6f-e482-4d46-a5f5-208ee3a8bd4f]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b8508-e1dd-4287-8c95-4dbf95b93c33]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e64d0e-faee-4db8-87dc-4bb177509721]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10df626-0220-4d1e-a7c4-4502a21b16b5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea27b935-a022-43eb-8bda-e95ebb050fdd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]
Nov 28 06:44:11 user nova-compute[74870]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.
Nov 28 06:44:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23f22f6-d94b-4859-a752-97b786be3434]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== disconnect_volume: return (302ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:44:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'migration_context' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG nova.objects.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Object Instance<41240cc1-28a3-4685-9f80-68f5e37945b7> lazy-loaded attributes: resources,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:12 user nova-compute[74870]: WARNING nova.compute.manager [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state resized and task_state resize_reverting.
Nov 28 06:44:12 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:44:12 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.506s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:13 user nova-compute[74870]: INFO nova.compute.manager [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Swapping old allocation on dict_keys(['815baae3-b790-4d61-806d-4eb5745b5a72']) held by migration 6566d01b-b539-4af6-bfe6-db894c82f82a for instance
Nov 28 06:44:13 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Overwriting current allocation {'allocations': {'815baae3-b790-4d61-806d-4eb5745b5a72': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'user_id': '18ee95f099b64968984fd3b9e418b048', 'consumer_generation': 1} on consumer 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG nova.network.neutron [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG nova.network.neutron [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG os_brick.utils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c60e5-14dc-4e8e-9ae8-89c5c325bb06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8f7eaf-c2b9-49d4-9eb8-db2110af6a7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0779e2-8a11-4c69-9867-0ddb1ccd4906]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74520a3-fa82-4c71-b846-cc5ce0f46a79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:44:13 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:44:13 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e02168d-523f-4015-9b21-423c1df06233]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:44:13 user nova-compute[74870]: DEBUG os_brick.utils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-41240cc1-28a3-4685-9f80-68f5e37945b7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 06:44:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:15 user nova-compute[74870]: INFO nova.compute.manager [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Unrescuing
Nov 28 06:44:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG nova.objects.instance [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'flavor' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-unplugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-unplugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:16 user nova-compute[74870]: WARNING nova.compute.manager [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-unplugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance destroyed successfully.
Nov 28 06:44:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing instance network info cache due to event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updated VIF entry in instance network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:18 user nova-compute[74870]: WARNING nova.compute.manager [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing instance network info cache due to event network-changed-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG nova.network.neutron [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Refreshing network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:44:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updated VIF entry in instance network info cache for port d2a8e63d-4f39-4ef4-9d23-ad1f72acb858. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:20 user nova-compute[74870]: WARNING nova.compute.manager [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] No waiting events found dispatching network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:20 user nova-compute[74870]: WARNING nova.compute.manager [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received unexpected event network-vif-plugged-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Starting finish_revert_migration {{(pid=74870) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start _get_guest_xml network_info=[{"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '41240cc1-28a3-4685-9f80-68f5e37945b7', 'attached_at': '2023-11-28T06:44:21.000000', 'detached_at': '', 'volume_id': 'a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'serial': 'a8b4ea4e-a453-4e9f-b0cf-79f87998b488'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '033a8452-a04a-468e-bba6-86c88ddc0c39', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:44:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.objects.instance [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:44:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:44:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:44:21 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b9a2c6-da91-47b9-bc44-bb2aef68fde2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:44:21 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad6d87-4451-472f-9721-39ddb01e70f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488] added
Nov 28 06:44:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.068s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a17919-b5e3-42e3-8bb5-4197c120a10b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[31618047-bbdc-4c0e-9c9f-1f231cabada5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYopuWvd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYopuWvd" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb310b4-968c-4c3c-bfd2-a819e84c9d64]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYopuWvd'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b581914f-5b1c-498e-8a6b-4dfeb3f44bca]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d7128-a1d1-4edd-b6fb-0b486f6ea464]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedaebd7-8a40-4b22-9d17-c2276a27699f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]
Nov 28 06:44:21 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.
Nov 28 06:44:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eb6720-0d78-4827-aca6-635a799a1211]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9616e7a-4b44-40c7-880c-ab684be796d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:44:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde1fb90-ab02-4797-82db-9c6b0dd3d64d]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '26433333636396337', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433333636396337', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:44:22 user nova-compute[74870]:   <uuid>41240cc1-28a3-4685-9f80-68f5e37945b7</uuid>
Nov 28 06:44:22 user nova-compute[74870]:   <name>instance-00000006</name>
Nov 28 06:44:22 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:44:22 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:44:22 user nova-compute[74870]:   <metadata>
Nov 28 06:44:22 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:44:22 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:44:22 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherB-server-1411738955</nova:name>
Nov 28 06:44:22 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:44:21</nova:creationTime>
Nov 28 06:44:22 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:44:22 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:44:22 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:44:22 user nova-compute[74870]:       <nova:owner>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:user uuid="18ee95f099b64968984fd3b9e418b048">tempest-ServerActionsTestOtherB-1422366079-project-member</nova:user>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:project uuid="739e836995bb4af6a877468ec43d0cf3">tempest-ServerActionsTestOtherB-1422366079</nova:project>
Nov 28 06:44:22 user nova-compute[74870]:       </nova:owner>
Nov 28 06:44:22 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:44:22 user nova-compute[74870]:       <nova:ports>
Nov 28 06:44:22 user nova-compute[74870]:         <nova:port uuid="717f616f-b485-4c7e-83be-a80086c19692">
Nov 28 06:44:22 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 06:44:22 user nova-compute[74870]:         </nova:port>
Nov 28 06:44:22 user nova-compute[74870]:       </nova:ports>
Nov 28 06:44:22 user nova-compute[74870]:     </nova:instance>
Nov 28 06:44:22 user nova-compute[74870]:   </metadata>
Nov 28 06:44:22 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:44:22 user nova-compute[74870]:     <system>
Nov 28 06:44:22 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:44:22 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:44:22 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:44:22 user nova-compute[74870]:       <entry name="serial">41240cc1-28a3-4685-9f80-68f5e37945b7</entry>
Nov 28 06:44:22 user nova-compute[74870]:       <entry name="uuid">41240cc1-28a3-4685-9f80-68f5e37945b7</entry>
Nov 28 06:44:22 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:44:22 user nova-compute[74870]:     </system>
Nov 28 06:44:22 user nova-compute[74870]:   </sysinfo>
Nov 28 06:44:22 user nova-compute[74870]:   <os>
Nov 28 06:44:22 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:44:22 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:44:22 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:44:22 user nova-compute[74870]:   </os>
Nov 28 06:44:22 user nova-compute[74870]:   <features>
Nov 28 06:44:22 user nova-compute[74870]:     <acpi/>
Nov 28 06:44:22 user nova-compute[74870]:     <apic/>
Nov 28 06:44:22 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:44:22 user nova-compute[74870]:   </features>
Nov 28 06:44:22 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:44:22 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:44:22 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:44:22 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:44:22 user nova-compute[74870]:   </clock>
Nov 28 06:44:22 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:44:22 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:44:22 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:44:22 user nova-compute[74870]:   </cpu>
Nov 28 06:44:22 user nova-compute[74870]:   <devices>
Nov 28 06:44:22 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:44:22 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:44:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk"/>
Nov 28 06:44:22 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:44:22 user nova-compute[74870]:     </disk>
Nov 28 06:44:22 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:44:22 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:44:22 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 06:44:22 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:44:22 user nova-compute[74870]:       <serial>a8b4ea4e-a453-4e9f-b0cf-79f87998b488</serial>
Nov 28 06:44:22 user nova-compute[74870]:     </disk>
Nov 28 06:44:22 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:44:22 user nova-compute[74870]:       <mac address="fa:16:3e:dd:63:14"/>
Nov 28 06:44:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:44:22 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:44:22 user nova-compute[74870]:       <target dev="tap717f616f-b4"/>
Nov 28 06:44:22 user nova-compute[74870]:     </interface>
Nov 28 06:44:22 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:44:22 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/console.log" append="off"/>
Nov 28 06:44:22 user nova-compute[74870]:     </serial>
Nov 28 06:44:22 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:44:22 user nova-compute[74870]:     <video>
Nov 28 06:44:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:44:22 user nova-compute[74870]:     </video>
Nov 28 06:44:22 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:44:22 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:44:22 user nova-compute[74870]:     </rng>
Nov 28 06:44:22 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:44:22 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:44:22 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:44:22 user nova-compute[74870]:     </memballoon>
Nov 28 06:44:22 user nova-compute[74870]:   </devices>
Nov 28 06:44:22 user nova-compute[74870]: </domain>
Nov 28 06:44:22 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG os_vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb571cf-ade1-590c-bba5-f636e398fb6c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717f616f-b4, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap717f616f-b4, col_values=(('qos', UUID('fa16b6ac-a051-4d50-93d4-18ec6f9f0368')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap717f616f-b4, col_values=(('external_ids', {'iface-id': '717f616f-b485-4c7e-83be-a80086c19692', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:63:14', 'vm-uuid': '41240cc1-28a3-4685-9f80-68f5e37945b7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:23 user nova-compute[74870]: INFO os_vif [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4')
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:24 user nova-compute[74870]: WARNING nova.compute.manager [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state resized and task_state resize_reverting.
Nov 28 06:44:24 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:44:24 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:44:24 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7085MB free_disk=25.07833480834961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:44:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.010s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] No waiting events found dispatching network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:26 user nova-compute[74870]: WARNING nova.compute.manager [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received unexpected event network-vif-plugged-717f616f-b485-4c7e-83be-a80086c19692 for instance with vm_state resized and task_state resize_reverting.
Nov 28 06:44:26 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:44:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:44:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance running successfully.
Nov 28 06:44:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] finish_revert_migration finished successfully. {{(pid=74870) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 06:44:27 user nova-compute[74870]: INFO nova.compute.manager [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance to original state: 'active'
Nov 28 06:44:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:29 user nova-compute[74870]: INFO nova.compute.manager [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Terminating instance
Nov 28 06:44:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-vif-unplugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] No waiting events found dispatching network-vif-unplugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-vif-unplugged-519d15c3-a87c-436b-aa7d-b6754a055382 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:44:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Instance destroyed successfully.
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'resources' on Instance uuid 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-621014352',display_name='tempest-VolumesAdminNegativeTest-server-621014352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-621014352',id=8,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMsHDWfSPBXeowpAfdbCkUBsb5GVuO2M2D2NvwxyTsWsRqGaxh5+cyygW6N+N2Y+05tishhYkLlG4xldaGcp+OIozUBSi77d0G9KooHgMQC8tV78aYf9oA5ssK3kLplYw==',key_name='tempest-keypair-1078616029',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c265a98d205f4b679d3a810b4745691a',ramdisk_id='',reservation_id='r-1o21bd87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1747870246',owner_user_name='tempest-VolumesAdminNegativeTest-1747870246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e8b23eae758490a8a2476797479f208',uuid=636fad3b-617f-4a65-8cf7-ef67fd68304b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converting VIF {"id": "519d15c3-a87c-436b-aa7d-b6754a055382", "address": "fa:16:3e:dd:8c:b1", "network": {"id": "01113f65-069a-4a01-937f-ff095f88202b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1001031728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c265a98d205f4b679d3a810b4745691a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap519d15c3-a8", "ovs_interfaceid": "519d15c3-a87c-436b-aa7d-b6754a055382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG os_vif [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap519d15c3-a8, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e114038f-6072-49b0-bff9-992aaac0b884) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:30 user nova-compute[74870]: INFO os_vif [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:8c:b1,bridge_name='br-int',has_traffic_filtering=True,id=519d15c3-a87c-436b-aa7d-b6754a055382,network=Network(01113f65-069a-4a01-937f-ff095f88202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap519d15c3-a8')
Nov 28 06:44:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Deleting instance files /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b_del
Nov 28 06:44:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Deletion of /opt/stack/data/nova/instances/636fad3b-617f-4a65-8cf7-ef67fd68304b_del complete
Nov 28 06:44:30 user nova-compute[74870]: INFO nova.compute.manager [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 06:44:30 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:44:30 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-changed-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Refreshing instance network info cache due to event network-changed-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG nova.network.neutron [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Refreshing network info cache for port 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:31 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Took 0.85 seconds to deallocate network for instance.
Nov 28 06:44:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.634s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Acquiring lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] No waiting events found dispatching network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:32 user nova-compute[74870]: WARNING nova.compute.manager [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received unexpected event network-vif-plugged-519d15c3-a87c-436b-aa7d-b6754a055382 for instance with vm_state deleted and task_state None.
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Received event network-vif-deleted-519d15c3-a87c-436b-aa7d-b6754a055382 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:32 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Deleted allocations for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updated VIF entry in instance network info cache for port 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "636fad3b-617f-4a65-8cf7-ef67fd68304b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 0b630563-12cc-467d-8908-e2a8fb230b62 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 5e69254a-5914-4e90-ae6e-bdf28ac716e7 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 25781b03-ef60-44cd-aab8-5f5b3350b8fd {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.161s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:44:47 user nova-compute[74870]: INFO nova.compute.claims [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Claim successful on node user
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:44:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.policy [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cff054e141e43feb19997a67027f5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:44:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Creating image(s)
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "/opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "/opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk 1073741824" returned: 0 in 0.065s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Successfully created port: a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:48 user nova-compute[74870]: INFO nova.compute.manager [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Detaching volume 7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:44:48 user nova-compute[74870]: INFO nova.virt.block_device [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Attempting to driver detach volume 7a1e0169-c086-4acb-a496-a8a00aaeca65 from mountpoint /dev/vdb
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Attempting to detach device vdb from instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:44:48 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:44:48 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:44:48 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:44:48 user nova-compute[74870]:   <serial>7a1e0169-c086-4acb-a496-a8a00aaeca65</serial>
Nov 28 06:44:48 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:44:48 user nova-compute[74870]: </disk>
Nov 28 06:44:48 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:44:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Successfully detached device vdb from instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 from the persistent domain config.
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:44:48 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:44:48 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:44:48 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:44:48 user nova-compute[74870]:   <serial>7a1e0169-c086-4acb-a496-a8a00aaeca65</serial>
Nov 28 06:44:48 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:44:48 user nova-compute[74870]: </disk>
Nov 28 06:44:48 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Cannot resize image /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Ensure instance console log exists: /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Successfully updated port: a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquired lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-changed-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Refreshing instance network info cache due to event network-changed-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Acquiring lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:44:49 user nova-compute[74870]: INFO nova.compute.manager [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Unrescuing
Nov 28 06:44:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updating instance_info_cache with network_info: [{"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Releasing lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Instance network_info: |[{"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Acquired lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Refreshing network info cache for port a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Start _get_guest_xml network_info=[{"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:44:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:44:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1285664',id=22,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr34jTxAgvpieMtESUKF9pO7y0EurVjqQ9xjdMeLwnzjkjuKNQ7iJVoSBKNvYBZIPKIBEj492DjxQnvCzD9J0jWg2c7JEs+zpI2+Oeup3XvLPpb0ZWo5Jl60bq3TCKyvA==',key_name='tempest-keypair-676620164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bc4dd85b0ff45bd8e13a8266b18b843',ramdisk_id='',reservation_id='r-76erjnuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-296558585',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cff054e141e43feb19997a67027f5bc',uuid=cb3a1360-d402-4962-9b05-ca0288480b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Converting VIF {"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lazy-loading 'pci_devices' on Instance uuid cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:44:49 user nova-compute[74870]:   <uuid>cb3a1360-d402-4962-9b05-ca0288480b10</uuid>
Nov 28 06:44:49 user nova-compute[74870]:   <name>instance-00000016</name>
Nov 28 06:44:49 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:44:49 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:44:49 user nova-compute[74870]:   <metadata>
Nov 28 06:44:49 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:44:49 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:44:49 user nova-compute[74870]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283</nova:name>
Nov 28 06:44:49 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:44:49</nova:creationTime>
Nov 28 06:44:49 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:44:49 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:44:49 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:44:49 user nova-compute[74870]:       <nova:owner>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:user uuid="5cff054e141e43feb19997a67027f5bc">tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member</nova:user>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:project uuid="8bc4dd85b0ff45bd8e13a8266b18b843">tempest-TestServerVolumeAttachScenarioOldVersion-296558585</nova:project>
Nov 28 06:44:49 user nova-compute[74870]:       </nova:owner>
Nov 28 06:44:49 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:44:49 user nova-compute[74870]:       <nova:ports>
Nov 28 06:44:49 user nova-compute[74870]:         <nova:port uuid="a89c6a82-52b2-4afa-b8e5-01cf52d7bb27">
Nov 28 06:44:49 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 06:44:49 user nova-compute[74870]:         </nova:port>
Nov 28 06:44:49 user nova-compute[74870]:       </nova:ports>
Nov 28 06:44:49 user nova-compute[74870]:     </nova:instance>
Nov 28 06:44:49 user nova-compute[74870]:   </metadata>
Nov 28 06:44:49 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:44:49 user nova-compute[74870]:     <system>
Nov 28 06:44:49 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:44:49 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:44:49 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:44:49 user nova-compute[74870]:       <entry name="serial">cb3a1360-d402-4962-9b05-ca0288480b10</entry>
Nov 28 06:44:49 user nova-compute[74870]:       <entry name="uuid">cb3a1360-d402-4962-9b05-ca0288480b10</entry>
Nov 28 06:44:49 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:44:49 user nova-compute[74870]:     </system>
Nov 28 06:44:49 user nova-compute[74870]:   </sysinfo>
Nov 28 06:44:49 user nova-compute[74870]:   <os>
Nov 28 06:44:49 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:44:49 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:44:49 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:44:49 user nova-compute[74870]:   </os>
Nov 28 06:44:49 user nova-compute[74870]:   <features>
Nov 28 06:44:49 user nova-compute[74870]:     <acpi/>
Nov 28 06:44:49 user nova-compute[74870]:     <apic/>
Nov 28 06:44:49 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:44:49 user nova-compute[74870]:   </features>
Nov 28 06:44:49 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:44:49 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:44:49 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:44:49 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:44:49 user nova-compute[74870]:   </clock>
Nov 28 06:44:49 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:44:49 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:44:49 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:44:49 user nova-compute[74870]:   </cpu>
Nov 28 06:44:49 user nova-compute[74870]:   <devices>
Nov 28 06:44:49 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:44:49 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:44:49 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk"/>
Nov 28 06:44:49 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:44:49 user nova-compute[74870]:     </disk>
Nov 28 06:44:49 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:44:49 user nova-compute[74870]:       <mac address="fa:16:3e:24:7d:ef"/>
Nov 28 06:44:49 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:44:49 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:44:49 user nova-compute[74870]:       <target dev="tapa89c6a82-52"/>
Nov 28 06:44:49 user nova-compute[74870]:     </interface>
Nov 28 06:44:49 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:44:49 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/console.log" append="off"/>
Nov 28 06:44:49 user nova-compute[74870]:     </serial>
Nov 28 06:44:49 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:44:49 user nova-compute[74870]:     <video>
Nov 28 06:44:49 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:44:49 user nova-compute[74870]:     </video>
Nov 28 06:44:49 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:44:49 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:44:49 user nova-compute[74870]:     </rng>
Nov 28 06:44:49 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:44:49 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:44:49 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:44:49 user nova-compute[74870]:     </memballoon>
Nov 28 06:44:49 user nova-compute[74870]:   </devices>
Nov 28 06:44:49 user nova-compute[74870]: </domain>
Nov 28 06:44:49 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1285664',id=22,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr34jTxAgvpieMtESUKF9pO7y0EurVjqQ9xjdMeLwnzjkjuKNQ7iJVoSBKNvYBZIPKIBEj492DjxQnvCzD9J0jWg2c7JEs+zpI2+Oeup3XvLPpb0ZWo5Jl60bq3TCKyvA==',key_name='tempest-keypair-676620164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bc4dd85b0ff45bd8e13a8266b18b843',ramdisk_id='',reservation_id='r-76erjnuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-296558585',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cff054e141e43feb19997a67027f5bc',uuid=cb3a1360-d402-4962-9b05-ca0288480b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Converting VIF {"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG os_vif [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea6e0c28-a192-542a-b80f-0984de9eda1f', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa89c6a82-52, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa89c6a82-52, col_values=(('qos', UUID('1115fce3-6399-4c6c-9ad8-6912ba7fc79b')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa89c6a82-52, col_values=(('external_ids', {'iface-id': 'a89c6a82-52b2-4afa-b8e5-01cf52d7bb27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:7d:ef', 'vm-uuid': 'cb3a1360-d402-4962-9b05-ca0288480b10'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:49 user nova-compute[74870]: INFO os_vif [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52')
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] No VIF found with MAC fa:16:3e:24:7d:ef, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updated VIF entry in instance network info cache for port a89c6a82-52b2-4afa-b8e5-01cf52d7bb27. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updating instance_info_cache with network_info: [{"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Releasing lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:50 user nova-compute[74870]: WARNING nova.compute.manager [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance destroyed successfully.
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] No waiting events found dispatching network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:51 user nova-compute[74870]: WARNING nova.compute.manager [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received unexpected event network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance with vm_state building and task_state spawning.
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:52 user nova-compute[74870]: WARNING nova.compute.manager [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] No waiting events found dispatching network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:53 user nova-compute[74870]: WARNING nova.compute.manager [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received unexpected event network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance with vm_state building and task_state spawning.
Nov 28 06:44:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:44:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Instance spawned successfully.
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:44:54 user nova-compute[74870]: INFO nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:54 user nova-compute[74870]: INFO nova.compute.manager [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Took 7.32 seconds to build instance.
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.413s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:54 user nova-compute[74870]: WARNING nova.compute.manager [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:44:54 user nova-compute[74870]: WARNING nova.compute.manager [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:44:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:44:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:44:59 user nova-compute[74870]: INFO nova.compute.claims [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Claim successful on node user
Nov 28 06:44:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:44:59 user nova-compute[74870]: INFO nova.compute.manager [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Unrescuing
Nov 28 06:44:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.952s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:44:59 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:45:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.policy [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:45:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Creating image(s)
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "/opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating instance_info_cache with network_info: [{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'flavor' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk 1073741824" returned: 0 in 0.064s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:00 user nova-compute[74870]: WARNING nova.compute.manager [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Successfully created port: b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.223s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:45:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Cannot resize image /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Ensure instance console log exists: /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:01 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance destroyed successfully.
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Successfully updated port: b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquired lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-changed-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Refreshing instance network info cache due to event network-changed-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Acquiring lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updating instance_info_cache with network_info: [{"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Releasing lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Instance network_info: |[{"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Acquired lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:01 user nova-compute[74870]: DEBUG nova.network.neutron [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Refreshing network info cache for port b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Start _get_guest_xml network_info=[{"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:45:02 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:45:02 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-875010330',display_name='tempest-AttachVolumeNegativeTest-server-875010330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-875010330',id=23,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb8WB6ij2s6GSTONUry95+XZmirnDSuGCLeYTlWhJo5pt46o5jzKSFOUsahma8KL6J42jbZN/OQdWkzrX5NrqDyqs21eSDp1KFumAwGYgOU0L1gYwgX4rEZDxatlltO6w==',key_name='tempest-keypair-1434653657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-c2jgvuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:45:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=46e43d2c-f91b-44cb-9cfe-a0e3682a12aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.objects.instance [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'pci_devices' on Instance uuid 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:45:02 user nova-compute[74870]:   <uuid>46e43d2c-f91b-44cb-9cfe-a0e3682a12aa</uuid>
Nov 28 06:45:02 user nova-compute[74870]:   <name>instance-00000017</name>
Nov 28 06:45:02 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:45:02 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:45:02 user nova-compute[74870]:   <metadata>
Nov 28 06:45:02 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:45:02 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:45:02 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-875010330</nova:name>
Nov 28 06:45:02 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:45:02</nova:creationTime>
Nov 28 06:45:02 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:45:02 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:45:02 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:45:02 user nova-compute[74870]:       <nova:owner>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:user uuid="05e396090c4b4a8995d8d2e66c8b3db0">tempest-AttachVolumeNegativeTest-538884229-project-member</nova:user>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:project uuid="5df9ec769206481e8dad48a6461c46ba">tempest-AttachVolumeNegativeTest-538884229</nova:project>
Nov 28 06:45:02 user nova-compute[74870]:       </nova:owner>
Nov 28 06:45:02 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:45:02 user nova-compute[74870]:       <nova:ports>
Nov 28 06:45:02 user nova-compute[74870]:         <nova:port uuid="b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f">
Nov 28 06:45:02 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:45:02 user nova-compute[74870]:         </nova:port>
Nov 28 06:45:02 user nova-compute[74870]:       </nova:ports>
Nov 28 06:45:02 user nova-compute[74870]:     </nova:instance>
Nov 28 06:45:02 user nova-compute[74870]:   </metadata>
Nov 28 06:45:02 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:45:02 user nova-compute[74870]:     <system>
Nov 28 06:45:02 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:45:02 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:45:02 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:45:02 user nova-compute[74870]:       <entry name="serial">46e43d2c-f91b-44cb-9cfe-a0e3682a12aa</entry>
Nov 28 06:45:02 user nova-compute[74870]:       <entry name="uuid">46e43d2c-f91b-44cb-9cfe-a0e3682a12aa</entry>
Nov 28 06:45:02 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:45:02 user nova-compute[74870]:     </system>
Nov 28 06:45:02 user nova-compute[74870]:   </sysinfo>
Nov 28 06:45:02 user nova-compute[74870]:   <os>
Nov 28 06:45:02 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:45:02 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:45:02 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:45:02 user nova-compute[74870]:   </os>
Nov 28 06:45:02 user nova-compute[74870]:   <features>
Nov 28 06:45:02 user nova-compute[74870]:     <acpi/>
Nov 28 06:45:02 user nova-compute[74870]:     <apic/>
Nov 28 06:45:02 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:45:02 user nova-compute[74870]:   </features>
Nov 28 06:45:02 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:45:02 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:45:02 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:45:02 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:45:02 user nova-compute[74870]:   </clock>
Nov 28 06:45:02 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:45:02 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:45:02 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:45:02 user nova-compute[74870]:   </cpu>
Nov 28 06:45:02 user nova-compute[74870]:   <devices>
Nov 28 06:45:02 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:45:02 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:45:02 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk"/>
Nov 28 06:45:02 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:45:02 user nova-compute[74870]:     </disk>
Nov 28 06:45:02 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:45:02 user nova-compute[74870]:       <mac address="fa:16:3e:30:59:b7"/>
Nov 28 06:45:02 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:45:02 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:45:02 user nova-compute[74870]:       <target dev="tapb4fa043b-e1"/>
Nov 28 06:45:02 user nova-compute[74870]:     </interface>
Nov 28 06:45:02 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:45:02 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/console.log" append="off"/>
Nov 28 06:45:02 user nova-compute[74870]:     </serial>
Nov 28 06:45:02 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:45:02 user nova-compute[74870]:     <video>
Nov 28 06:45:02 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:45:02 user nova-compute[74870]:     </video>
Nov 28 06:45:02 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:45:02 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:45:02 user nova-compute[74870]:     </rng>
Nov 28 06:45:02 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:45:02 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:45:02 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:45:02 user nova-compute[74870]:     </memballoon>
Nov 28 06:45:02 user nova-compute[74870]:   </devices>
Nov 28 06:45:02 user nova-compute[74870]: </domain>
Nov 28 06:45:02 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-875010330',display_name='tempest-AttachVolumeNegativeTest-server-875010330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-875010330',id=23,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb8WB6ij2s6GSTONUry95+XZmirnDSuGCLeYTlWhJo5pt46o5jzKSFOUsahma8KL6J42jbZN/OQdWkzrX5NrqDyqs21eSDp1KFumAwGYgOU0L1gYwgX4rEZDxatlltO6w==',key_name='tempest-keypair-1434653657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-c2jgvuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:45:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=46e43d2c-f91b-44cb-9cfe-a0e3682a12aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG os_vif [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '177a48d7-b0b1-5d35-a587-d1dbb92dd6ce', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4fa043b-e1, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4fa043b-e1, col_values=(('qos', UUID('633976fb-3a10-4807-b4d5-10c0fb17f6f6')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4fa043b-e1, col_values=(('external_ids', {'iface-id': 'b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:59:b7', 'vm-uuid': '46e43d2c-f91b-44cb-9cfe-a0e3682a12aa'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:02 user nova-compute[74870]: INFO os_vif [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1')
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:30:59:b7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.network.neutron [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updated VIF entry in instance network info cache for port b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.network.neutron [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updating instance_info_cache with network_info: [{"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Releasing lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:02 user nova-compute[74870]: WARNING nova.compute.manager [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:45:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] No waiting events found dispatching network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:04 user nova-compute[74870]: WARNING nova.compute.manager [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received unexpected event network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance with vm_state building and task_state spawning.
Nov 28 06:45:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:05 user nova-compute[74870]: WARNING nova.compute.manager [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:45:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:05 user nova-compute[74870]: WARNING nova.compute.manager [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:45:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] No waiting events found dispatching network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:06 user nova-compute[74870]: WARNING nova.compute.manager [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received unexpected event network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance with vm_state building and task_state spawning.
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:45:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Instance spawned successfully.
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:06 user nova-compute[74870]: INFO nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 28 06:45:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:45:06 user nova-compute[74870]: INFO nova.compute.manager [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Took 7.95 seconds to build instance.
Nov 28 06:45:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.080s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-changed-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Refreshing instance network info cache due to event network-changed-ea9497df-2959-489f-a6d7-4ce7a474741d. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Acquiring lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Acquired lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG nova.network.neutron [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Refreshing network info cache for port ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG nova.network.neutron [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Updated VIF entry in instance network info cache for port ea9497df-2959-489f-a6d7-4ce7a474741d. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG nova.network.neutron [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Updating instance_info_cache with network_info: [{"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Releasing lock "refresh_cache-9ec477b1-ae4b-4ec0-b396-353c82f38972" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:09 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 is timed out.
Nov 28 06:45:09 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Successfully detached device vdb from instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 from the live domain config.
Nov 28 06:45:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwZQhAgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:09 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9c507-fa5f-4be9-a183-e22451b81ab5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:45:09 user nova-compute[74870]: No targets found.
Nov 28 06:45:09 user nova-compute[74870]: iSNS:
Nov 28 06:45:09 user nova-compute[74870]: No targets found.
Nov 28 06:45:09 user nova-compute[74870]: STATIC:
Nov 28 06:45:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65
Nov 28 06:45:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:45:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:45:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:09 user nova-compute[74870]: FIRMWARE:
Nov 28 06:45:09 user nova-compute[74870]: No targets found.
Nov 28 06:45:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:45:09 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:45:09 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75693690-77de-43e0-ae87-308b883a5684]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a07db8-4e34-47c7-bee1-40e897026263]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:09 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:45:09 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:09 user nova-compute[74870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 (non-flash)
Nov 28 06:45:09 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc69f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65'): ({'sdg'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Removing single pathed devices sdg {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ffd687-7eb5-4e02-ab42-ef496d879957]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e61c5d-dcf2-49e8-a424-dc50f7e63af2]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flushing IO for device /dev/sdg {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579eda4-8248-4ddf-8c65-5a9736fe7c1c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8281c4-d019-42ff-97d5-4a192dff275e]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde81b01-631f-40bd-953c-3f8a630618be]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d36a0e5-39dd-48be-a624-ab2d7e44584b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260]
Nov 28 06:45:09 user nova-compute[74870]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a1e0169-c086-4acb-a496-a8a00aaeca65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f947f25-6e01-4ba9-a27e-1d353070daf9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] <== disconnect_volume: return (330ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:45:10 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:10 user nova-compute[74870]: DEBUG nova.objects.instance [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'flavor' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.960s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.objects.instance [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lazy-loading 'flavor' on Instance uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-changed-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Refreshing instance network info cache due to event network-changed-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Acquiring lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Acquired lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Refreshing network info cache for port 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:11 user nova-compute[74870]: INFO nova.compute.manager [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Attaching volume ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 to /dev/sdc
Nov 28 06:45:11 user nova-compute[74870]: DEBUG os_brick.utils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[268520d3-4cd3-4a6e-9842-da98a868762b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e42f8e-d801-4215-8ee7-2e582c1b174c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d98a11-3d13-4e61-ac45-01971840c717]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fd456-d9ce-4674-933a-5bdcc5af9086]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:45:11 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe10d3-f9f9-43c3-b245-13e65920fa26]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG os_brick.utils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Updating existing volume attachment record: db597d71-1fa4-4cfd-bd96-2b8631eb9e85 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'flavor' on Instance uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updated VIF entry in instance network info cache for port 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updating instance_info_cache with network_info: [{"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Releasing lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:11 user nova-compute[74870]: INFO nova.compute.manager [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Attaching volume 6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef to /dev/vdb
Nov 28 06:45:12 user nova-compute[74870]: DEBUG os_brick.utils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6f37e-647f-4961-97e4-69601fc9ebde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6898ed6a-d8e5-4d00-bb1a-036f17f0ee13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be6a816-833d-4cce-99dc-7bfe93b95ef5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c469cb-f757-4813-bc16-3167b94e6dd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:45:12 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:45:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5327c9ff-f8ca-4531-983e-2ad66c2c1d38]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG os_brick.utils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updating existing volume attachment record: 49badf01-e9a7-4bc7-98a6-97000ccf5867 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:45:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [{"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-0e5b898b-f5f0-4504-94d0-53bf8d622620" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:45:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHnfkRWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:18 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab171f1-38ef-4557-a37c-428843912376]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:45:18 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b0f00-1bd4-4bbd-8ab7-e0697e597671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6] added
Nov 28 06:45:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed8fbca-fdf0-4f63-bfe1-8ad32d964da6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8da737f-4a60-4c2d-bdf2-70c66521ebaa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHnfkRWA {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHnfkRWA" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0259f1-00ad-455c-a57c-a7f4425a6d29]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qHnfkRWA'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb2ae5-5dfe-4a61-acf6-1a4a63458698]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwQECoFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:19 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d0013d-a34b-44f0-b00e-af2df78dbe8f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb8e5e-b0b7-4d86-9516-0c3c7b11998e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260]
Nov 28 06:45:19 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[659236be-cefc-47cc-918d-fe345be47b38]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e7e33-aa53-4d6a-94c1-32f2128d3090]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:19 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc195a7-632b-41b0-80c4-dd95e490e49d]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHnfkRWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23364666336613561', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364666336613561', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.199s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:20 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:20 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.objects.instance [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lazy-loading 'flavor' on Instance uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1baf19f-4588-4000-83e4-9ce88788c16a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:45:20 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:45:20 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:20 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:45:20 user nova-compute[74870]:   <target dev="sdc" bus="scsi"/>
Nov 28 06:45:20 user nova-compute[74870]:   <serial>ea3ac2c8-063c-4125-94c4-cc13e6fb07f6</serial>
Nov 28 06:45:20 user nova-compute[74870]:   <address type="drive" controller="0" unit="2"/>
Nov 28 06:45:20 user nova-compute[74870]: </disk>
Nov 28 06:45:20 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa076901-c03d-4d2f-812d-da6a18fc9eb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef] added
Nov 28 06:45:20 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78464e-9156-4cbb-87c6-7267f5c1530d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.123s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb28ce4-15c1-4fe3-9137-da96bddfeb87]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwQECoFH {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwQECoFH" returned: 0 in 0.195s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e5b7b-cf05-407f-937b-64adbe963c39]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwQECoFH'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c21f53-3801-41d2-ad79-aa5773b7bfa6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19ca5a-8534-453a-aa0d-00f08bb6811d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:20 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:20 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:20 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:20 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:20 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:20 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No BDM found with device name sda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] No VIF found with MAC fa:16:3e:3a:e5:1f, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:45:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce190a6-c56c-4175-852c-6321e9d41fba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260]
Nov 28 06:45:21 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80a88c0-d9ea-4ce7-a06f-12076fb5a96e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72781745-53fa-406b-af00-d93018acba25]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:21 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:21 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:21 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:21 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:21 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:21 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.735s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0649a4a-02d6-4629-b233-0556491baf43]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwQECoFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.793s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.790s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] <== connect_volume: return (2991ms) {'type': 'block', 'scsi_wwn': '23831383461636462', 'path': '/dev/sde'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383461636462', 'path': '/dev/sde'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'flavor' on Instance uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:45:22 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:22 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:45:22 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:45:22 user nova-compute[74870]:   <serial>6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef</serial>
Nov 28 06:45:22 user nova-compute[74870]: </disk>
Nov 28 06:45:22 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:45:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:45:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=6892MB free_disk=25.094501495361328GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:22 user nova-compute[74870]: INFO nova.compute.manager [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Detaching volume ea3ac2c8-063c-4125-94c4-cc13e6fb07f6
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] No VIF found with MAC fa:16:3e:e0:75:70, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:45:23 user nova-compute[74870]: INFO nova.virt.block_device [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Attempting to driver detach volume ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 from mountpoint /dev/sdc
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Attempting to detach device sdc from instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:45:23 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:23 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:45:23 user nova-compute[74870]:   <target dev="sdc" bus="scsi"/>
Nov 28 06:45:23 user nova-compute[74870]:   <serial>ea3ac2c8-063c-4125-94c4-cc13e6fb07f6</serial>
Nov 28 06:45:23 user nova-compute[74870]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 06:45:23 user nova-compute[74870]: </disk>
Nov 28 06:45:23 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:45:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Successfully detached device sdc from instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 from the persistent domain config.
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:45:23 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:23 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:45:23 user nova-compute[74870]:   <target dev="sdc" bus="scsi"/>
Nov 28 06:45:23 user nova-compute[74870]:   <serial>ea3ac2c8-063c-4125-94c4-cc13e6fb07f6</serial>
Nov 28 06:45:23 user nova-compute[74870]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 06:45:23 user nova-compute[74870]: </disk>
Nov 28 06:45:23 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance cb3a1360-d402-4962-9b05-ca0288480b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.191s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:45:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:45:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:25 user nova-compute[74870]: INFO nova.compute.manager [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Detaching volume 6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef
Nov 28 06:45:25 user nova-compute[74870]: INFO nova.virt.block_device [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Attempting to driver detach volume 6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef from mountpoint /dev/vdb
Nov 28 06:45:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Attempting to detach device vdb from instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:45:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:45:25 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:25 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:45:25 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:45:25 user nova-compute[74870]:   <serial>6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef</serial>
Nov 28 06:45:25 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:45:25 user nova-compute[74870]: </disk>
Nov 28 06:45:25 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:45:25 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully detached device vdb from instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c from the persistent domain config.
Nov 28 06:45:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:45:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:45:25 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:25 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:45:25 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:45:25 user nova-compute[74870]:   <serial>6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef</serial>
Nov 28 06:45:25 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:45:25 user nova-compute[74870]: </disk>
Nov 28 06:45:25 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:45:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:45:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:29 user nova-compute[74870]: DEBUG nova.objects.instance [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lazy-loading 'flavor' on Instance uuid 25781b03-ef60-44cd-aab8-5f5b3350b8fd {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:30 user nova-compute[74870]: INFO nova.compute.manager [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Attaching volume c4911020-1539-498a-bb5e-65870f6658e4 to /dev/vdb
Nov 28 06:45:30 user nova-compute[74870]: DEBUG os_brick.utils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d698af60-f47d-4fff-b529-82b93d0f4223]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc97d20-a010-4bad-b5e8-db5d2d6f0340]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32404db-1392-45e2-827c-4ceb8d06c644]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79438b1-6532-4b90-ace6-f8db13384dca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:45:30 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:45:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614e8e0-984e-4057-a407-33604635f0b3]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG os_brick.utils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:30 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Updating existing volume attachment record: c78a1014-5c79-45cd-a69c-db3bba95e32a {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:45:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:45:37 user nova-compute[74870]: INFO nova.compute.claims [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Claim successful on node user
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvzIKapM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:37 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:37 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:37 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ae266a-31e7-4e6a-9ea2-39a21c107855]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:45:37 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b874500-31fd-49bd-b4a6-372e1c17860a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4] added
Nov 28 06:45:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[388ffade-067c-4aaf-9a1c-bace43a9fce6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b59ee6-decd-4214-acfe-caa4d8a78ec2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvzIKapM {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvzIKapM" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c3e95e-ea48-4600-8fc7-d630c6887aee]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvzIKapM'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79ae656-4005-466c-8ba6-2b67e5e4a558]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1106d11d-bf76-4c26-9eb9-f0c1bc7f391d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:45:37 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4f555-e5f4-4a74-8237-4c7ef1e8c999]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260]
Nov 28 06:45:37 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f710e9a-0c80-4bf7-9dd5-57578a40d7aa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3054c-a9f7-4455-9718-54104eb4f35e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:37 user nova-compute[74870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 (non-flash)
Nov 28 06:45:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:45:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.policy [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca080c-322b-475f-9f25-31bcbb843717]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:45:38 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Creating image(s)
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk 1073741824" returned: 0 in 0.054s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Successfully created port: d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Ensure instance console log exists: /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvzIKapM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26138643366343233', 'path': '/dev/sdf'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138643366343233', 'path': '/dev/sdf'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lazy-loading 'flavor' on Instance uuid 25781b03-ef60-44cd-aab8-5f5b3350b8fd {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:45:39 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:45:39 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:45:39 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:45:39 user nova-compute[74870]:   <serial>c4911020-1539-498a-bb5e-65870f6658e4</serial>
Nov 28 06:45:39 user nova-compute[74870]: </disk>
Nov 28 06:45:39 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:39 user nova-compute[74870]: INFO nova.compute.manager [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Terminating instance
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Successfully updated port: d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquired lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-changed-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Refreshing instance network info cache due to event network-changed-d20c570c-280d-472a-a11a-3e13c3920461. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Acquiring lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] No VIF found with MAC fa:16:3e:02:16:b7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.386s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Releasing lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance network_info: |[{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Acquired lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Refreshing network info cache for port d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start _get_guest_xml network_info=[{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:45:39 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:45:39 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:45:39 user nova-compute[74870]:   <uuid>bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</uuid>
Nov 28 06:45:39 user nova-compute[74870]:   <name>instance-00000018</name>
Nov 28 06:45:39 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:45:39 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:45:39 user nova-compute[74870]:   <metadata>
Nov 28 06:45:39 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:45:39 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:45:39 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeTestJSON-server-1513439293</nova:name>
Nov 28 06:45:39 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:45:39</nova:creationTime>
Nov 28 06:45:39 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:45:39 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:45:39 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:45:39 user nova-compute[74870]:       <nova:owner>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:user uuid="63fdd08d34954e97ae65ec1ce1c3d0f6">tempest-AttachVolumeTestJSON-25504685-project-member</nova:user>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:project uuid="2a4f8529212249d68a54698cffcdc44b">tempest-AttachVolumeTestJSON-25504685</nova:project>
Nov 28 06:45:39 user nova-compute[74870]:       </nova:owner>
Nov 28 06:45:39 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:45:39 user nova-compute[74870]:       <nova:ports>
Nov 28 06:45:39 user nova-compute[74870]:         <nova:port uuid="d20c570c-280d-472a-a11a-3e13c3920461">
Nov 28 06:45:39 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:45:39 user nova-compute[74870]:         </nova:port>
Nov 28 06:45:39 user nova-compute[74870]:       </nova:ports>
Nov 28 06:45:39 user nova-compute[74870]:     </nova:instance>
Nov 28 06:45:39 user nova-compute[74870]:   </metadata>
Nov 28 06:45:39 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:45:39 user nova-compute[74870]:     <system>
Nov 28 06:45:39 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:45:39 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:45:39 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:45:39 user nova-compute[74870]:       <entry name="serial">bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</entry>
Nov 28 06:45:39 user nova-compute[74870]:       <entry name="uuid">bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</entry>
Nov 28 06:45:39 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:45:39 user nova-compute[74870]:     </system>
Nov 28 06:45:39 user nova-compute[74870]:   </sysinfo>
Nov 28 06:45:39 user nova-compute[74870]:   <os>
Nov 28 06:45:39 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:45:39 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:45:39 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:45:39 user nova-compute[74870]:   </os>
Nov 28 06:45:39 user nova-compute[74870]:   <features>
Nov 28 06:45:39 user nova-compute[74870]:     <acpi/>
Nov 28 06:45:39 user nova-compute[74870]:     <apic/>
Nov 28 06:45:39 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:45:39 user nova-compute[74870]:   </features>
Nov 28 06:45:39 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:45:39 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:45:39 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:45:39 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:45:39 user nova-compute[74870]:   </clock>
Nov 28 06:45:39 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:45:39 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:45:39 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:45:39 user nova-compute[74870]:   </cpu>
Nov 28 06:45:39 user nova-compute[74870]:   <devices>
Nov 28 06:45:39 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:45:39 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:45:39 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk"/>
Nov 28 06:45:39 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:45:39 user nova-compute[74870]:     </disk>
Nov 28 06:45:39 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:45:39 user nova-compute[74870]:       <mac address="fa:16:3e:88:f4:5c"/>
Nov 28 06:45:39 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:45:39 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:45:39 user nova-compute[74870]:       <target dev="tapd20c570c-28"/>
Nov 28 06:45:39 user nova-compute[74870]:     </interface>
Nov 28 06:45:39 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:45:39 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/console.log" append="off"/>
Nov 28 06:45:39 user nova-compute[74870]:     </serial>
Nov 28 06:45:39 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:45:39 user nova-compute[74870]:     <video>
Nov 28 06:45:39 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:45:39 user nova-compute[74870]:     </video>
Nov 28 06:45:39 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:45:39 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:45:39 user nova-compute[74870]:     </rng>
Nov 28 06:45:39 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:45:39 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:45:39 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:45:39 user nova-compute[74870]:     </memballoon>
Nov 28 06:45:39 user nova-compute[74870]:   </devices>
Nov 28 06:45:39 user nova-compute[74870]: </domain>
Nov 28 06:45:39 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG os_vif [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb7f9cc8-f611-5d81-a1db-5424875809b0', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20c570c-28, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd20c570c-28, col_values=(('qos', UUID('e10f38f0-1953-47e1-8561-0952ec25d310')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd20c570c-28, col_values=(('external_ids', {'iface-id': 'd20c570c-280d-472a-a11a-3e13c3920461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:f4:5c', 'vm-uuid': 'bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: INFO os_vif [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28')
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No VIF found with MAC fa:16:3e:88:f4:5c, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:45:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Instance destroyed successfully.
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'resources' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-692038908',display_name='tempest-ServerStableDeviceRescueTest-server-692038908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-692038908',id=7,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFaerc1nUtKDnRM+r90VFYRGdV10VQFWDLQhuqYU/TPWJ+sUFq9W+68zFlEuxEiYAsWAKxBO79ot31nQIU3RWockau4p3vhK1K7n+Hcw0HsUre+LAFsc8TGx8g99OMQA==',key_name='tempest-keypair-142163135',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b30dc21619f949b18be9362b217e7c1b',ramdisk_id='',reservation_id='r-aiq041ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1091796361',owner_user_name='tempest-ServerStableDeviceRescueTest-1091796361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f53e7a2f95545d196a5b2d36ef6d692',uuid=0e5b898b-f5f0-4504-94d0-53bf8d622620,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converting VIF {"id": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "address": "fa:16:3e:21:69:bf", "network": {"id": "c14a902d-8f0e-4a96-841e-176e395b16c9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-634953965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30dc21619f949b18be9362b217e7c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a8e63d-4f", "ovs_interfaceid": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG os_vif [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a8e63d-4f, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=800f0f24-2d31-4318-9708-8f5b7f441819) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:39 user nova-compute[74870]: INFO os_vif [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:69:bf,bridge_name='br-int',has_traffic_filtering=True,id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858,network=Network(c14a902d-8f0e-4a96-841e-176e395b16c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a8e63d-4f')
Nov 28 06:45:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Deleting instance files /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620_del
Nov 28 06:45:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Deletion of /opt/stack/data/nova/instances/0e5b898b-f5f0-4504-94d0-53bf8d622620_del complete
Nov 28 06:45:40 user nova-compute[74870]: INFO nova.compute.manager [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:40 user nova-compute[74870]: INFO nova.compute.manager [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Terminating instance
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updated VIF entry in instance network info cache for port d20c570c-280d-472a-a11a-3e13c3920461. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Releasing lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:40 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Took 0.71 seconds to deallocate network for instance.
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Received event network-vif-deleted-d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:40 user nova-compute[74870]: INFO nova.compute.manager [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Neutron deleted interface d2a8e63d-4f39-4ef4-9d23-ad1f72acb858; detaching it from the instance and deleting it from the info cache
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Detach interface failed, port_id=d2a8e63d-4f39-4ef4-9d23-ad1f72acb858, reason: Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Instance destroyed successfully.
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.objects.instance [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lazy-loading 'resources' on Instance uuid 25781b03-ef60-44cd-aab8-5f5b3350b8fd {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-254217302',display_name='tempest-DeleteServersTestJSON-server-254217302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-254217302',id=21,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:43:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa4536fef53e47e4aac07b82ff452fd6',ramdisk_id='',reservation_id='r-0jc80md3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1238418010',owner_user_name='tempest-DeleteServersTestJSON-1238418010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:43:45Z,user_data=None,user_id='65a520d2b45446098b6b97532a696bd8',uuid=25781b03-ef60-44cd-aab8-5f5b3350b8fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Converting VIF {"id": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "address": "fa:16:3e:02:16:b7", "network": {"id": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174400127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa4536fef53e47e4aac07b82ff452fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4a143d-6a", "ovs_interfaceid": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_vif [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4a143d-6a, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6655e588-9ea7-479d-94a4-bca97880c2ef) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: INFO os_vif [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=6e4a143d-6a3f-45dc-955f-f6be6c3918ae,network=Network(75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4a143d-6a')
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvzIKapM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:41 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa8452-2f31-417f-866f-a354c0dd31af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:45:41 user nova-compute[74870]: No targets found.
Nov 28 06:45:41 user nova-compute[74870]: iSNS:
Nov 28 06:45:41 user nova-compute[74870]: No targets found.
Nov 28 06:45:41 user nova-compute[74870]: STATIC:
Nov 28 06:45:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4
Nov 28 06:45:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:45:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6
Nov 28 06:45:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:45:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef
Nov 28 06:45:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:41 user nova-compute[74870]: FIRMWARE:
Nov 28 06:45:41 user nova-compute[74870]: No targets found.
Nov 28 06:45:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:45:41 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:45:41 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24efcc9e-3048-4dfd-a305-b544bf2ad714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f947b3b-e76c-4530-a4b2-2e7e206597b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:41 user nova-compute[74870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 (non-flash)
Nov 28 06:45:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef41380d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4'): ({'sdf'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Removing single pathed devices sdf {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ae639-b8be-4ed5-9319-19b5cb8bfc7d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc0e841-5b83-452f-8a55-2e6d6e63f909]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Flushing IO for device /dev/sdf {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[372367e4-7587-4790-ac92-f9e1bc31bf78]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-vif-unplugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] No waiting events found dispatching network-vif-unplugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-vif-unplugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Acquiring lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] No waiting events found dispatching network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:41 user nova-compute[74870]: WARNING nova.compute.manager [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received unexpected event network-vif-plugged-6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance with vm_state active and task_state deleting.
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70df2af-816d-4b3d-9d41-ac82dd53b3f4]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Deleted allocations for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c841d7b-10f6-4c2d-b94e-1c09befd135a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275eed6-8bec-4981-94d8-37e612cecba0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260]
Nov 28 06:45:41 user nova-compute[74870]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "0e5b898b-f5f0-4504-94d0-53bf8d622620" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.446s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4911020-1539-498a-bb5e-65870f6658e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6affec-a23b-4366-88d8-f01e8beebf20]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] <== disconnect_volume: return (357ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:45:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Deleting instance files /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd_del
Nov 28 06:45:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Deletion of /opt/stack/data/nova/instances/25781b03-ef60-44cd-aab8-5f5b3350b8fd_del complete
Nov 28 06:45:41 user nova-compute[74870]: INFO nova.compute.manager [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 28 06:45:41 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:45:41 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:42 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Took 0.67 seconds to deallocate network for instance.
Nov 28 06:45:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:42 user nova-compute[74870]: WARNING nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state building and task_state spawning.
Nov 28 06:45:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:42 user nova-compute[74870]: WARNING nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state building and task_state spawning.
Nov 28 06:45:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Received event network-vif-deleted-6e4a143d-6a3f-45dc-955f-f6be6c3918ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:43 user nova-compute[74870]: INFO nova.compute.manager [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:43 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 is timed out.
Nov 28 06:45:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Successfully detached device sdc from instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 from the live domain config.
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHnfkRWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:43 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f483c9-eab9-46f1-a698-0e5edbe110db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:45:43 user nova-compute[74870]: No targets found.
Nov 28 06:45:43 user nova-compute[74870]: iSNS:
Nov 28 06:45:43 user nova-compute[74870]: No targets found.
Nov 28 06:45:43 user nova-compute[74870]: STATIC:
Nov 28 06:45:43 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:45:43 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:43 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:43 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6
Nov 28 06:45:43 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:43 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:43 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:45:43 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:43 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:43 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef
Nov 28 06:45:43 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:43 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:43 user nova-compute[74870]: FIRMWARE:
Nov 28 06:45:43 user nova-compute[74870]: No targets found.
Nov 28 06:45:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:45:43 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:45:43 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a480bdb8-03a1-479a-b132-cf503b70462b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae553197-9f6b-4ceb-acf8-44345fc44d21]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:43 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:43 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:43 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:43 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:43 user nova-compute[74870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 (non-flash)
Nov 28 06:45:43 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc558b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:45:43 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Deleted allocations for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.115s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ba0ce-7c84-475c-a3bf-8a14d24c8f72]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "25781b03-ef60-44cd-aab8-5f5b3350b8fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.657s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd87aa-d6a3-467e-9a4a-1e8ec755bfac]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd9557-03b6-4472-9080-a20ccd39e33b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:45:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance spawned successfully.
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f3857f-e2f9-4c2b-8a28-920d3a24977c]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3607210f-0e83-449c-9433-ca08dd2712f0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:43 user nova-compute[74870]: INFO nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4959e35a-da94-4c2e-b424-97956b0b7835]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260]
Nov 28 06:45:43 user nova-compute[74870]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05b05e-1a8e-48fc-a617-5bcc9436781d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] <== disconnect_volume: return (416ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:45:44 user nova-compute[74870]: INFO nova.compute.manager [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Took 6.86 seconds to build instance.
Nov 28 06:45:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.954s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:44 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lazy-loading 'flavor' on Instance uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:45 user nova-compute[74870]: INFO nova.compute.manager [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Terminating instance
Nov 28 06:45:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-vif-unplugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] No waiting events found dispatching network-vif-unplugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-vif-unplugged-ea9497df-2959-489f-a6d7-4ce7a474741d for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:45:45 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c is timed out.
Nov 28 06:45:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully detached device vdb from instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c from the live domain config.
Nov 28 06:45:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwQECoFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:45:45 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b477e-27dc-43b5-ae9c-8ba9a5e62a95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:45:45 user nova-compute[74870]: No targets found.
Nov 28 06:45:45 user nova-compute[74870]: iSNS:
Nov 28 06:45:45 user nova-compute[74870]: No targets found.
Nov 28 06:45:45 user nova-compute[74870]: STATIC:
Nov 28 06:45:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:45:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:45:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef
Nov 28 06:45:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:45:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:45:45 user nova-compute[74870]: FIRMWARE:
Nov 28 06:45:45 user nova-compute[74870]: No targets found.
Nov 28 06:45:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:45:45 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:45:45 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea4dcff-df20-4293-9875-20fd2fd99dfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.067s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0263e6f1-236c-4c51-9611-bae1acc0f6f3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:45 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:45 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:45:45 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:45:45 user nova-compute[74870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef (non-flash)
Nov 28 06:45:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef41d3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef'): ({'sde'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Removing single pathed devices sde {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[68402ef4-1cd8-4c9c-8594-0795a84a40ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ce7002-18ad-4861-bc8d-d7b7f437d143]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flushing IO for device /dev/sde {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[62169c7a-7cf4-4e41-bb98-7f0e719fdf30]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b81f4-cc55-4a49-8bf3-0f8294a7c5b4]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[933910f6-e973-4d23-96de-9de1cac70615]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e500d-be8c-449d-a1da-619f04fae907]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260]
Nov 28 06:45:46 user nova-compute[74870]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef, portal: 172.16.0.220,3260] successful.
Nov 28 06:45:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc8512-ae7d-4e40-97dd-3913cfaef71e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] <== disconnect_volume: return (384ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Instance destroyed successfully.
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lazy-loading 'resources' on Instance uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2105331009',display_name='tempest-AttachSCSIVolumeTestJSON-server-2105331009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2105331009',id=19,image_ref='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIVLH1EMKjoa8/5idYsoqJ/Gd6qA/lgnXxioHq5yn0go7DEbTlnSQHYoZwO2InVEgB69dENX4prOHb5gFHZNz2jR3GGDYquPPt0HIfVcbrMHKnsWuf698tJWffDPd9nCg==',key_name='tempest-keypair-1058119261',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f11f8db963684cba9927a06dfb035bd3',ramdisk_id='',reservation_id='r-cwch0tpj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-952007140',owner_user_name='tempest-AttachSCSIVolumeTestJSON-952007140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3ace56f1264298944b8b765f51417f',uuid=9ec477b1-ae4b-4ec0-b396-353c82f38972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Converting VIF {"id": "ea9497df-2959-489f-a6d7-4ce7a474741d", "address": "fa:16:3e:3a:e5:1f", "network": {"id": "34f8060a-c521-4e81-955b-52ed0199e018", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-586338392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f11f8db963684cba9927a06dfb035bd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9497df-29", "ovs_interfaceid": "ea9497df-2959-489f-a6d7-4ce7a474741d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG os_vif [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea9497df-29, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec23e57f-d68d-421b-92db-225cb6325bcb) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:46 user nova-compute[74870]: INFO os_vif [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:e5:1f,bridge_name='br-int',has_traffic_filtering=True,id=ea9497df-2959-489f-a6d7-4ce7a474741d,network=Network(34f8060a-c521-4e81-955b-52ed0199e018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9497df-29')
Nov 28 06:45:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Deleting instance files /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972_del
Nov 28 06:45:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Deletion of /opt/stack/data/nova/instances/9ec477b1-ae4b-4ec0-b396-353c82f38972_del complete
Nov 28 06:45:46 user nova-compute[74870]: INFO nova.compute.manager [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'flavor' on Instance uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:46 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:45:46 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Took 0.64 seconds to deallocate network for instance.
Nov 28 06:45:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:47 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:45:47 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:45:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:47 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Deleted allocations for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972
Nov 28 06:45:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Acquiring lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:45:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:45:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Lock "9ec477b1-ae4b-4ec0-b396-353c82f38972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:45:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] No waiting events found dispatching network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:45:48 user nova-compute[74870]: WARNING nova.compute.manager [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received unexpected event network-vif-plugged-ea9497df-2959-489f-a6d7-4ce7a474741d for instance with vm_state deleted and task_state None.
Nov 28 06:45:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Received event network-vif-deleted-ea9497df-2959-489f-a6d7-4ce7a474741d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:45:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:45:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 06:45:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:45:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:45:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:45:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:12 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-changed-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Refreshing instance network info cache due to event network-changed-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:46:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Acquiring lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Acquired lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Refreshing network info cache for port 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:16 user nova-compute[74870]: INFO nova.compute.manager [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Terminating instance
Nov 28 06:46:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-vif-unplugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] No waiting events found dispatching network-vif-unplugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-vif-unplugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updated VIF entry in instance network info cache for port 4c2e30a2-39fb-43e0-bcea-6a752bc5a76b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updating instance_info_cache with network_info: [{"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Releasing lock "refresh_cache-77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Instance destroyed successfully.
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'resources' on Instance uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-835941228',display_name='tempest-TestStampPattern-server-835941228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-835941228',id=20,image_ref='a909e0d0-4869-4e36-a872-7b376b6589c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A==',key_name='tempest-TestStampPattern-1173073735',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48cff8da56da484d9dfee1b8118474b9',ramdisk_id='',reservation_id='r-mdg76erv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5',image_min_disk='1',image_min_ram='0',image_owner_id='48cff8da56da484d9dfee1b8118474b9',image_owner_project_name='tempest-TestStampPattern-415121645',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-415121645-project-member',image_user_id='73373ee05e1b4e09b5c0870750a77262',owner_project_name='tempest-TestStampPattern-415121645',owner_user_name='tempest-TestStampPattern-415121645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:43:29Z,user_data=None,user_id='73373ee05e1b4e09b5c0870750a77262',uuid=77393c2a-5fb1-48ec-88bd-a13fc6f39f3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converting VIF {"id": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "address": "fa:16:3e:e0:75:70", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2e30a2-39", "ovs_interfaceid": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG os_vif [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c2e30a2-39, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0b3254d-6139-4eb5-8861-bafc16245d24) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:17 user nova-compute[74870]: INFO os_vif [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:75:70,bridge_name='br-int',has_traffic_filtering=True,id=4c2e30a2-39fb-43e0-bcea-6a752bc5a76b,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2e30a2-39')
Nov 28 06:46:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Deleting instance files /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c_del
Nov 28 06:46:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Deletion of /opt/stack/data/nova/instances/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c_del complete
Nov 28 06:46:17 user nova-compute[74870]: INFO nova.compute.manager [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:17 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Took 0.39 seconds to deallocate network for instance.
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:17 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Deleted allocations for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c
Nov 28 06:46:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-vif-deleted-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.956s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received event network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Acquiring lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Lock "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] No waiting events found dispatching network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:46:18 user nova-compute[74870]: WARNING nova.compute.manager [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Received unexpected event network-vif-plugged-4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance with vm_state deleted and task_state None.
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.200435638427734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance cb3a1360-d402-4962-9b05-ca0288480b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:46:22 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:46:23 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:46:23 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:46:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:46:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:46:24 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:46:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:46:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:25 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:46:25 user nova-compute[74870]: INFO nova.compute.claims [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Claim successful on node user
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:46:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.policy [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:46:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Creating image(s)
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk 1073741824" returned: 0 in 0.054s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Successfully created port: 5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Cannot resize image /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Ensure instance console log exists: /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Successfully updated port: 5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquired lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-changed-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Refreshing instance network info cache due to event network-changed-5a6dbf47-1250-4f02-87b4-6d33d64d34eb. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Acquiring lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updating instance_info_cache with network_info: [{"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Releasing lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance network_info: |[{"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Acquired lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Refreshing network info cache for port 5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:46:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Start _get_guest_xml network_info=[{"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:46:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-865386610',display_name='tempest-tempest.common.compute-instance-865386610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-865386610',id=25,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ==',key_name='tempest-keypair-940347240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-0n77xil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=30c7dc1e-9569-49f5-aabf-a98cba6470fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'pci_devices' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:46:28 user nova-compute[74870]:   <uuid>30c7dc1e-9569-49f5-aabf-a98cba6470fa</uuid>
Nov 28 06:46:28 user nova-compute[74870]:   <name>instance-00000019</name>
Nov 28 06:46:28 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:46:28 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:46:28 user nova-compute[74870]:   <metadata>
Nov 28 06:46:28 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:46:28 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:46:28 user nova-compute[74870]:       <nova:name>tempest-tempest.common.compute-instance-865386610</nova:name>
Nov 28 06:46:28 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:46:28</nova:creationTime>
Nov 28 06:46:28 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:46:28 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:46:28 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:46:28 user nova-compute[74870]:       <nova:owner>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:user uuid="b7b9a26798e14399ac1a70568432485e">tempest-ServerActionsTestOtherA-1541374155-project-member</nova:user>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:project uuid="ccf9caaf7cab4c0eb3343ea2c2501481">tempest-ServerActionsTestOtherA-1541374155</nova:project>
Nov 28 06:46:28 user nova-compute[74870]:       </nova:owner>
Nov 28 06:46:28 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:46:28 user nova-compute[74870]:       <nova:ports>
Nov 28 06:46:28 user nova-compute[74870]:         <nova:port uuid="5a6dbf47-1250-4f02-87b4-6d33d64d34eb">
Nov 28 06:46:28 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 06:46:28 user nova-compute[74870]:         </nova:port>
Nov 28 06:46:28 user nova-compute[74870]:       </nova:ports>
Nov 28 06:46:28 user nova-compute[74870]:     </nova:instance>
Nov 28 06:46:28 user nova-compute[74870]:   </metadata>
Nov 28 06:46:28 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:46:28 user nova-compute[74870]:     <system>
Nov 28 06:46:28 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:46:28 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:46:28 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:46:28 user nova-compute[74870]:       <entry name="serial">30c7dc1e-9569-49f5-aabf-a98cba6470fa</entry>
Nov 28 06:46:28 user nova-compute[74870]:       <entry name="uuid">30c7dc1e-9569-49f5-aabf-a98cba6470fa</entry>
Nov 28 06:46:28 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:46:28 user nova-compute[74870]:     </system>
Nov 28 06:46:28 user nova-compute[74870]:   </sysinfo>
Nov 28 06:46:28 user nova-compute[74870]:   <os>
Nov 28 06:46:28 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:46:28 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:46:28 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:46:28 user nova-compute[74870]:   </os>
Nov 28 06:46:28 user nova-compute[74870]:   <features>
Nov 28 06:46:28 user nova-compute[74870]:     <acpi/>
Nov 28 06:46:28 user nova-compute[74870]:     <apic/>
Nov 28 06:46:28 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:46:28 user nova-compute[74870]:   </features>
Nov 28 06:46:28 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:46:28 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:46:28 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:46:28 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:46:28 user nova-compute[74870]:   </clock>
Nov 28 06:46:28 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:46:28 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:46:28 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:46:28 user nova-compute[74870]:   </cpu>
Nov 28 06:46:28 user nova-compute[74870]:   <devices>
Nov 28 06:46:28 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:46:28 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:46:28 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk"/>
Nov 28 06:46:28 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:46:28 user nova-compute[74870]:     </disk>
Nov 28 06:46:28 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:46:28 user nova-compute[74870]:       <mac address="fa:16:3e:a8:ad:04"/>
Nov 28 06:46:28 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:46:28 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:46:28 user nova-compute[74870]:       <target dev="tap5a6dbf47-12"/>
Nov 28 06:46:28 user nova-compute[74870]:     </interface>
Nov 28 06:46:28 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:46:28 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/console.log" append="off"/>
Nov 28 06:46:28 user nova-compute[74870]:     </serial>
Nov 28 06:46:28 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:46:28 user nova-compute[74870]:     <video>
Nov 28 06:46:28 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:46:28 user nova-compute[74870]:     </video>
Nov 28 06:46:28 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:46:28 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:46:28 user nova-compute[74870]:     </rng>
Nov 28 06:46:28 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:46:28 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:46:28 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:46:28 user nova-compute[74870]:     </memballoon>
Nov 28 06:46:28 user nova-compute[74870]:   </devices>
Nov 28 06:46:28 user nova-compute[74870]: </domain>
Nov 28 06:46:28 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-865386610',display_name='tempest-tempest.common.compute-instance-865386610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-865386610',id=25,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ==',key_name='tempest-keypair-940347240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-0n77xil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=30c7dc1e-9569-49f5-aabf-a98cba6470fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG os_vif [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cf04eb3-8486-5fab-a408-2e27c443c1d4', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a6dbf47-12, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a6dbf47-12, col_values=(('qos', UUID('7e5d6201-7ed9-4d9c-83b9-ad94f0570a3b')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a6dbf47-12, col_values=(('external_ids', {'iface-id': '5a6dbf47-1250-4f02-87b4-6d33d64d34eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ad:04', 'vm-uuid': '30c7dc1e-9569-49f5-aabf-a98cba6470fa'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:28 user nova-compute[74870]: INFO os_vif [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12')
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No VIF found with MAC fa:16:3e:a8:ad:04, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updated VIF entry in instance network info cache for port 5a6dbf47-1250-4f02-87b4-6d33d64d34eb. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updating instance_info_cache with network_info: [{"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Releasing lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:46:29 user nova-compute[74870]: WARNING nova.compute.manager [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state building and task_state spawning.
Nov 28 06:46:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:46:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance spawned successfully.
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:46:31 user nova-compute[74870]: WARNING nova.compute.manager [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state building and task_state spawning.
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:32 user nova-compute[74870]: INFO nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 28 06:46:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:46:32 user nova-compute[74870]: INFO nova.compute.manager [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Took 6.30 seconds to build instance.
Nov 28 06:46:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.389s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-changed-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Refreshing instance network info cache due to event network-changed-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Acquiring lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Acquired lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Refreshing network info cache for port a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updated VIF entry in instance network info cache for port a89c6a82-52b2-4afa-b8e5-01cf52d7bb27. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updating instance_info_cache with network_info: [{"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Releasing lock "refresh_cache-cb3a1360-d402-4962-9b05-ca0288480b10" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:41 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lazy-loading 'flavor' on Instance uuid cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:42 user nova-compute[74870]: INFO nova.compute.manager [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Attaching volume 24cf45f7-d5e5-4e17-82bf-581233d29ba3 to /dev/vdb
Nov 28 06:46:42 user nova-compute[74870]: DEBUG os_brick.utils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc07693-5522-4d34-825b-8a0193534855]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f023b1-c29e-4de1-be57-d88442a8e90f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c0f8d3-76a8-4aee-a5ff-9a3b7dd8d1cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa234e51-190f-48be-8737-cbd0b38cec5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:46:42 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:46:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8e0a0-fbfb-4fb4-be82-32a4a43cf0dc]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG os_brick.utils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:46:42 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updating existing volume attachment record: 4978bcbe-a7c4-4baf-a9fa-5468e72aad2a {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:46:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:46:46 user nova-compute[74870]: INFO nova.compute.claims [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Claim successful on node user
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:46:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.policy [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:46:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Creating image(s)
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.216s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk 1073741824" returned: 0 in 0.158s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.244s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Cannot resize image /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Ensure instance console log exists: /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Successfully created port: 05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Successfully updated port: 05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing instance network info cache due to event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqcOCUhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:46:50 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:46:50 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:46:50 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7eca8d-34bc-4427-9e7a-86b4697f5c04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:46:50 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a47bdb-6850-4512-9648-5b4200d0b23a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3] added
Nov 28 06:46:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3677ef-0b2a-4c38-9f15-4ed4b13b746a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be141aa-083c-4fe3-91b5-6563502f967a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqcOCUhA {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqcOCUhA" returned: 0 in 0.033s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[941c8d46-b425-460f-b5e5-ad2e473fbbb8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqcOCUhA'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70543b-16b9-4a46-8cc3-90a276632288]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-changed-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Refreshing instance network info cache due to event network-changed-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Acquiring lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Acquired lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Refreshing network info cache for port b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b9fc86-faf2-4d92-ba54-cee34626d51a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b7eca-7811-4d9e-abaa-30b99c637ebf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260]
Nov 28 06:46:50 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260] successful.
Nov 28 06:46:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance network_info: |[{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Start _get_guest_xml network_info=[{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b6d57-5c02-4992-8bef-adc467c86b04]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:50 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621425112',display_name='tempest-ServerRescueNegativeTestJSON-server-1621425112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621425112',id=26,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCT7W9jPmL2DNpNb9OOlPJ8LYFXcuPwkRJcaH1BxAIpcqXX2ZN2vfpsNvMAsDzCxKGMuLnCMHJxT/KP2cJ3GsZiR1qHhSqRW1ZO6lSQzJztb7FbdXbjL1GzTWYUBOtmlQ==',key_name='tempest-keypair-2000231521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-pcfpikup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=de112cbb-849e-43c1-961a-4457585f2e9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.objects.instance [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'pci_devices' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6855143-a1c1-4a37-8f54-faefceb5ff03]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:46:50 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:46:50 user nova-compute[74870]:   <uuid>de112cbb-849e-43c1-961a-4457585f2e9a</uuid>
Nov 28 06:46:50 user nova-compute[74870]:   <name>instance-0000001a</name>
Nov 28 06:46:50 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:46:50 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:46:50 user nova-compute[74870]:   <metadata>
Nov 28 06:46:50 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:46:50 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:46:50 user nova-compute[74870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1621425112</nova:name>
Nov 28 06:46:50 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:46:50</nova:creationTime>
Nov 28 06:46:50 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:46:50 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:46:50 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:46:50 user nova-compute[74870]:       <nova:owner>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:user uuid="109001cce8ec4aa0b87f271b415cd5e6">tempest-ServerRescueNegativeTestJSON-226827849-project-member</nova:user>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:project uuid="8f90603ba77644568ec6f6fd37689a08">tempest-ServerRescueNegativeTestJSON-226827849</nova:project>
Nov 28 06:46:50 user nova-compute[74870]:       </nova:owner>
Nov 28 06:46:50 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:46:50 user nova-compute[74870]:       <nova:ports>
Nov 28 06:46:50 user nova-compute[74870]:         <nova:port uuid="05ecf301-f2f8-4953-997c-6855e4f27db7">
Nov 28 06:46:50 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 06:46:50 user nova-compute[74870]:         </nova:port>
Nov 28 06:46:50 user nova-compute[74870]:       </nova:ports>
Nov 28 06:46:50 user nova-compute[74870]:     </nova:instance>
Nov 28 06:46:50 user nova-compute[74870]:   </metadata>
Nov 28 06:46:50 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:46:50 user nova-compute[74870]:     <system>
Nov 28 06:46:50 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:46:50 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:46:50 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:46:50 user nova-compute[74870]:       <entry name="serial">de112cbb-849e-43c1-961a-4457585f2e9a</entry>
Nov 28 06:46:50 user nova-compute[74870]:       <entry name="uuid">de112cbb-849e-43c1-961a-4457585f2e9a</entry>
Nov 28 06:46:50 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:46:50 user nova-compute[74870]:     </system>
Nov 28 06:46:50 user nova-compute[74870]:   </sysinfo>
Nov 28 06:46:50 user nova-compute[74870]:   <os>
Nov 28 06:46:50 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:46:50 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:46:50 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:46:50 user nova-compute[74870]:   </os>
Nov 28 06:46:50 user nova-compute[74870]:   <features>
Nov 28 06:46:50 user nova-compute[74870]:     <acpi/>
Nov 28 06:46:50 user nova-compute[74870]:     <apic/>
Nov 28 06:46:50 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:46:50 user nova-compute[74870]:   </features>
Nov 28 06:46:50 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:46:50 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:46:50 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:46:50 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:46:50 user nova-compute[74870]:   </clock>
Nov 28 06:46:50 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:46:50 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:46:50 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:46:50 user nova-compute[74870]:   </cpu>
Nov 28 06:46:50 user nova-compute[74870]:   <devices>
Nov 28 06:46:50 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:46:50 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:46:50 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk"/>
Nov 28 06:46:50 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:46:50 user nova-compute[74870]:     </disk>
Nov 28 06:46:50 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:46:50 user nova-compute[74870]:       <mac address="fa:16:3e:e7:56:7b"/>
Nov 28 06:46:50 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:46:50 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:46:50 user nova-compute[74870]:       <target dev="tap05ecf301-f2"/>
Nov 28 06:46:50 user nova-compute[74870]:     </interface>
Nov 28 06:46:50 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:46:50 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/console.log" append="off"/>
Nov 28 06:46:50 user nova-compute[74870]:     </serial>
Nov 28 06:46:50 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:46:50 user nova-compute[74870]:     <video>
Nov 28 06:46:50 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:46:50 user nova-compute[74870]:     </video>
Nov 28 06:46:50 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:46:50 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:46:50 user nova-compute[74870]:     </rng>
Nov 28 06:46:50 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:46:50 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:46:50 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:46:50 user nova-compute[74870]:     </memballoon>
Nov 28 06:46:50 user nova-compute[74870]:   </devices>
Nov 28 06:46:50 user nova-compute[74870]: </domain>
Nov 28 06:46:50 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621425112',display_name='tempest-ServerRescueNegativeTestJSON-server-1621425112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621425112',id=26,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCT7W9jPmL2DNpNb9OOlPJ8LYFXcuPwkRJcaH1BxAIpcqXX2ZN2vfpsNvMAsDzCxKGMuLnCMHJxT/KP2cJ3GsZiR1qHhSqRW1ZO6lSQzJztb7FbdXbjL1GzTWYUBOtmlQ==',key_name='tempest-keypair-2000231521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-pcfpikup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=de112cbb-849e-43c1-961a-4457585f2e9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_vif [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b7bde9e-087e-52eb-9b9a-653c1d1005fc', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a01ff-a94f-45d7-8f5c-64fabf00b756]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqcOCUhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05ecf301-f2, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05ecf301-f2, col_values=(('qos', UUID('df1e0ce0-5ae5-4584-92b1-cb820a466cef')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05ecf301-f2, col_values=(('external_ids', {'iface-id': '05ecf301-f2f8-4953-997c-6855e4f27db7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:56:7b', 'vm-uuid': 'de112cbb-849e-43c1-961a-4457585f2e9a'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:50 user nova-compute[74870]: INFO os_vif [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2')
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:e7:56:7b, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updated VIF entry in instance network info cache for port b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updating instance_info_cache with network_info: [{"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Releasing lock "refresh_cache-46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.network.neutron [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updated VIF entry in instance network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.network.neutron [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23563343963363562', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563343963363562', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lazy-loading 'flavor' on Instance uuid cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:46:51 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:46:51 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:46:51 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:46:51 user nova-compute[74870]:   <serial>24cf45f7-d5e5-4e17-82bf-581233d29ba3</serial>
Nov 28 06:46:51 user nova-compute[74870]: </disk>
Nov 28 06:46:51 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:46:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] No VIF found with MAC fa:16:3e:24:7d:ef, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.991s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:46:52 user nova-compute[74870]: INFO nova.compute.claims [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Claim successful on node user
Nov 28 06:46:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:46:52 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:46:52 user nova-compute[74870]: DEBUG nova.policy [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:46:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Creating image(s)
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "/opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG nova.objects.instance [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:53 user nova-compute[74870]: INFO nova.compute.manager [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Attaching volume 5fb72480-0480-4bd1-b99b-437dbcddc280 to /dev/vdb
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.248s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG os_brick.utils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk 1073741824" returned: 0 in 0.072s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3de9f6-7c9f-4f48-911d-cdbca81b5cd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3bdb8d-7079-4223-8a9e-3cf441d029c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33437076-93d0-47be-8e05-217d4a675380]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[738ddfbc-8955-465f-850f-df7a733d5c54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:46:53 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[123e8bd9-8780-4873-af3e-18451fc9d5f6]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG os_brick.utils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updating existing volume attachment record: b2bd5667-595e-45c2-a7e6-a9c69303362e {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Successfully created port: 0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.241s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:46:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Cannot resize image /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Ensure instance console log exists: /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:46:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance spawned successfully.
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:46:54 user nova-compute[74870]: INFO nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Took 7.55 seconds to spawn the instance on the hypervisor.
Nov 28 06:46:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:46:55 user nova-compute[74870]: INFO nova.compute.manager [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Took 8.45 seconds to build instance.
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.555s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:55 user nova-compute[74870]: INFO nova.compute.manager [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Detaching volume 24cf45f7-d5e5-4e17-82bf-581233d29ba3
Nov 28 06:46:55 user nova-compute[74870]: INFO nova.virt.block_device [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Attempting to driver detach volume 24cf45f7-d5e5-4e17-82bf-581233d29ba3 from mountpoint /dev/vdb
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Attempting to detach device vdb from instance cb3a1360-d402-4962-9b05-ca0288480b10 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:46:55 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:46:55 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:46:55 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:46:55 user nova-compute[74870]:   <serial>24cf45f7-d5e5-4e17-82bf-581233d29ba3</serial>
Nov 28 06:46:55 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:46:55 user nova-compute[74870]: </disk>
Nov 28 06:46:55 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Successfully detached device vdb from instance cb3a1360-d402-4962-9b05-ca0288480b10 from the persistent domain config.
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb3a1360-d402-4962-9b05-ca0288480b10 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:46:55 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:46:55 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:46:55 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:46:55 user nova-compute[74870]:   <serial>24cf45f7-d5e5-4e17-82bf-581233d29ba3</serial>
Nov 28 06:46:55 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:46:55 user nova-compute[74870]: </disk>
Nov 28 06:46:55 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:46:55 user nova-compute[74870]: WARNING nova.compute.manager [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state None.
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Successfully updated port: 0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-changed-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Refreshing instance network info cache due to event network-changed-0af514bf-1b38-47e8-97a8-7e1c3d34246a. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Acquiring lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:46:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Updating instance_info_cache with network_info: [{"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Instance network_info: |[{"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Acquired lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.network.neutron [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Refreshing network info cache for port 0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Start _get_guest_xml network_info=[{"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:46:56 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:56 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1112120856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1112120856',id=27,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-l8cdhw1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:53Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=e23537de-fa1e-4cd2-8050-04ef2b911ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'pci_devices' on Instance uuid e23537de-fa1e-4cd2-8050-04ef2b911ac8 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:46:56 user nova-compute[74870]:   <uuid>e23537de-fa1e-4cd2-8050-04ef2b911ac8</uuid>
Nov 28 06:46:56 user nova-compute[74870]:   <name>instance-0000001b</name>
Nov 28 06:46:56 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:46:56 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:46:56 user nova-compute[74870]:   <metadata>
Nov 28 06:46:56 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:46:56 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:46:56 user nova-compute[74870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1112120856</nova:name>
Nov 28 06:46:56 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:46:56</nova:creationTime>
Nov 28 06:46:56 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:46:56 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:46:56 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:46:56 user nova-compute[74870]:       <nova:owner>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:user uuid="c13b793a926942e88fc3416cf3fa005e">tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member</nova:user>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:project uuid="a07e9312175c4e73aa29a51865d61ebd">tempest-ServerBootFromVolumeStableRescueTest-397751332</nova:project>
Nov 28 06:46:56 user nova-compute[74870]:       </nova:owner>
Nov 28 06:46:56 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:46:56 user nova-compute[74870]:       <nova:ports>
Nov 28 06:46:56 user nova-compute[74870]:         <nova:port uuid="0af514bf-1b38-47e8-97a8-7e1c3d34246a">
Nov 28 06:46:56 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:46:56 user nova-compute[74870]:         </nova:port>
Nov 28 06:46:56 user nova-compute[74870]:       </nova:ports>
Nov 28 06:46:56 user nova-compute[74870]:     </nova:instance>
Nov 28 06:46:56 user nova-compute[74870]:   </metadata>
Nov 28 06:46:56 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:46:56 user nova-compute[74870]:     <system>
Nov 28 06:46:56 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:46:56 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:46:56 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:46:56 user nova-compute[74870]:       <entry name="serial">e23537de-fa1e-4cd2-8050-04ef2b911ac8</entry>
Nov 28 06:46:56 user nova-compute[74870]:       <entry name="uuid">e23537de-fa1e-4cd2-8050-04ef2b911ac8</entry>
Nov 28 06:46:56 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:46:56 user nova-compute[74870]:     </system>
Nov 28 06:46:56 user nova-compute[74870]:   </sysinfo>
Nov 28 06:46:56 user nova-compute[74870]:   <os>
Nov 28 06:46:56 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:46:56 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:46:56 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:46:56 user nova-compute[74870]:   </os>
Nov 28 06:46:56 user nova-compute[74870]:   <features>
Nov 28 06:46:56 user nova-compute[74870]:     <acpi/>
Nov 28 06:46:56 user nova-compute[74870]:     <apic/>
Nov 28 06:46:56 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:46:56 user nova-compute[74870]:   </features>
Nov 28 06:46:56 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:46:56 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:46:56 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:46:56 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:46:56 user nova-compute[74870]:   </clock>
Nov 28 06:46:56 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:46:56 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:46:56 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:46:56 user nova-compute[74870]:   </cpu>
Nov 28 06:46:56 user nova-compute[74870]:   <devices>
Nov 28 06:46:56 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:46:56 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:46:56 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk"/>
Nov 28 06:46:56 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:46:56 user nova-compute[74870]:     </disk>
Nov 28 06:46:56 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:46:56 user nova-compute[74870]:       <mac address="fa:16:3e:1c:23:dc"/>
Nov 28 06:46:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:46:56 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:46:56 user nova-compute[74870]:       <target dev="tap0af514bf-1b"/>
Nov 28 06:46:56 user nova-compute[74870]:     </interface>
Nov 28 06:46:56 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:46:56 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/console.log" append="off"/>
Nov 28 06:46:56 user nova-compute[74870]:     </serial>
Nov 28 06:46:56 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:46:56 user nova-compute[74870]:     <video>
Nov 28 06:46:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:46:56 user nova-compute[74870]:     </video>
Nov 28 06:46:56 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:46:56 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:46:56 user nova-compute[74870]:     </rng>
Nov 28 06:46:56 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:46:56 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:46:56 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:46:56 user nova-compute[74870]:     </memballoon>
Nov 28 06:46:56 user nova-compute[74870]:   </devices>
Nov 28 06:46:56 user nova-compute[74870]: </domain>
Nov 28 06:46:56 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1112120856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1112120856',id=27,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-l8cdhw1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:53Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=e23537de-fa1e-4cd2-8050-04ef2b911ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG os_vif [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5339e94c-34de-5b85-b5e7-f3898ab0f603', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0af514bf-1b, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0af514bf-1b, col_values=(('qos', UUID('dc9a1b72-c5cd-41da-aa08-b3bacbbc47f1')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0af514bf-1b, col_values=(('external_ids', {'iface-id': '0af514bf-1b38-47e8-97a8-7e1c3d34246a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:23:dc', 'vm-uuid': 'e23537de-fa1e-4cd2-8050-04ef2b911ac8'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:56 user nova-compute[74870]: INFO os_vif [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b')
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:46:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No VIF found with MAC fa:16:3e:1c:23:dc, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG nova.network.neutron [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Updated VIF entry in instance network info cache for port 0af514bf-1b38-47e8-97a8-7e1c3d34246a. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG nova.network.neutron [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Updating instance_info_cache with network_info: [{"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Releasing lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:46:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:46:57 user nova-compute[74870]: WARNING nova.compute.manager [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state None.
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:46:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:47:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Instance spawned successfully.
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:00 user nova-compute[74870]: INFO nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Took 7.64 seconds to spawn the instance on the hypervisor.
Nov 28 06:47:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:47:00 user nova-compute[74870]: INFO nova.compute.manager [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Took 8.68 seconds to build instance.
Nov 28 06:47:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.819s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:01 user nova-compute[74870]: INFO nova.compute.manager [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Terminating instance
Nov 28 06:47:01 user nova-compute[74870]: DEBUG nova.compute.manager [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Instance destroyed successfully.
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.objects.instance [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lazy-loading 'resources' on Instance uuid 41240cc1-28a3-4685-9f80-68f5e37945b7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1411738955',display_name='tempest-ServerActionsTestOtherB-server-1411738955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1411738955',id=6,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw==',key_name='tempest-keypair-1612163949',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='739e836995bb4af6a877468ec43d0cf3',ramdisk_id='',reservation_id='r-dyeghlks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1422366079',owner_user_name='tempest-ServerActionsTestOtherB-1422366079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ee95f099b64968984fd3b9e418b048',uuid=41240cc1-28a3-4685-9f80-68f5e37945b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converting VIF {"id": "717f616f-b485-4c7e-83be-a80086c19692", "address": "fa:16:3e:dd:63:14", "network": {"id": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-488960258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "739e836995bb4af6a877468ec43d0cf3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717f616f-b4", "ovs_interfaceid": "717f616f-b485-4c7e-83be-a80086c19692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_vif [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717f616f-b4, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa16b6ac-a051-4d50-93d4-18ec6f9f0368) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:02 user nova-compute[74870]: INFO os_vif [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:63:14,bridge_name='br-int',has_traffic_filtering=True,id=717f616f-b485-4c7e-83be-a80086c19692,network=Network(9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717f616f-b4')
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYopuWvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b6fc1-e509-49e5-9417-5134215e6620]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:47:02 user nova-compute[74870]: No targets found.
Nov 28 06:47:02 user nova-compute[74870]: iSNS:
Nov 28 06:47:02 user nova-compute[74870]: No targets found.
Nov 28 06:47:02 user nova-compute[74870]: STATIC:
Nov 28 06:47:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488
Nov 28 06:47:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:47:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3
Nov 28 06:47:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:02 user nova-compute[74870]: FIRMWARE:
Nov 28 06:47:02 user nova-compute[74870]: No targets found.
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:47:02 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:47:02 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8b2ff9-dd33-4b3a-a4e5-a788ba0f0e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BxjkRIKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf5bb96-adf6-423b-af2c-f2eb5a08abab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef42f69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4b5123-773c-4d5e-b992-571898299640]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c7fe77-6eac-4653-954a-c3c0b85a8082]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786bf80-c7b7-4708-94ec-c693355912ec]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[321547d8-e50c-4c89-94a6-776c83927d0b]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:02 user nova-compute[74870]: INFO nova.compute.manager [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Terminating instance
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bb3297-0356-4e0e-ae40-4bb064218dda]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d725f8e7-54b8-4f4a-aa53-0e78b137767b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260]
Nov 28 06:47:02 user nova-compute[74870]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488, portal: 172.16.0.220,3260] successful.
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b4ea4e-a453-4e9f-b0cf-79f87998b488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d53d9b-1775-4586-b11b-fd5e9fe77ab8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] <== disconnect_volume: return (394ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:47:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Deleting instance files /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7_del
Nov 28 06:47:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Deletion of /opt/stack/data/nova/instances/41240cc1-28a3-4685-9f80-68f5e37945b7_del complete
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.339s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:02 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[886ba7d7-b50f-4154-86e8-f51f3264bd6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:47:02 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd5a51-d9c1-43f5-9d89-cf8a1d70aad7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280] added
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8fa3fd-0a1d-4fb7-857e-cd7a7a8fdfbb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: INFO nova.compute.manager [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b23660-284a-4a97-a010-59d19329c430]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BxjkRIKG {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BxjkRIKG" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[608486b6-b39e-4900-86aa-dc6741e732aa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BxjkRIKG'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae563be3-c6d4-4c96-8043-1a47018469e0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaea9ab-100e-4085-b212-b5e820116def]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[737fdbea-a0c4-4111-b865-44a9be50e892]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260]
Nov 28 06:47:02 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260] successful.
Nov 28 06:47:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2aaf0-6394-45a8-8f9f-c4b0b71b75c9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825f46e-fc2a-4c61-b6eb-b84e83df979f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:03 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:03 user nova-compute[74870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)
Nov 28 06:47:03 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:03 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:03 user nova-compute[74870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)
Nov 28 06:47:03 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[068246db-3133-42bf-975e-2831094323af]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:47:03 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Instance destroyed successfully.
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lazy-loading 'resources' on Instance uuid d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-453551306',display_name='tempest-ServersNegativeTestJSON-server-453551306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-453551306',id=3,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6362608255de47c3afa716e3091af3d0',ramdisk_id='',reservation_id='r-pkp5df1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1666481027',owner_user_name='tempest-ServersNegativeTestJSON-1666481027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:38:34Z,user_data=None,user_id='5bd89a43a3bf4952a40cd1dd07de2442',uuid=d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converting VIF {"id": "505345c6-a079-468d-be35-64932bcaef25", "address": "fa:16:3e:e1:d2:3e", "network": {"id": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-745481510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6362608255de47c3afa716e3091af3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap505345c6-a0", "ovs_interfaceid": "505345c6-a079-468d-be35-64932bcaef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG os_vif [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap505345c6-a0, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9fe8217-cd62-46f9-9c34-6e2ed3d3e3d0) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:03 user nova-compute[74870]: INFO os_vif [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:d2:3e,bridge_name='br-int',has_traffic_filtering=True,id=505345c6-a079-468d-be35-64932bcaef25,network=Network(25e958b1-76c6-4b10-aa2d-7792c3a7c44a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505345c6-a0')
Nov 28 06:47:03 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Deleting instance files /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e_del
Nov 28 06:47:03 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Deletion of /opt/stack/data/nova/instances/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e_del complete
Nov 28 06:47:03 user nova-compute[74870]: INFO nova.compute.manager [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] No waiting events found dispatching network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:03 user nova-compute[74870]: WARNING nova.compute.manager [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received unexpected event network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance with vm_state active and task_state None.
Nov 28 06:47:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BxjkRIKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== connect_volume: return (1723ms) {'type': 'block', 'scsi_wwn': '23637623731653338', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637623731653338', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.objects.instance [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:47:04 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:47:04 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 06:47:04 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:47:04 user nova-compute[74870]:   <serial>5fb72480-0480-4bd1-b99b-437dbcddc280</serial>
Nov 28 06:47:04 user nova-compute[74870]: </disk>
Nov 28 06:47:04 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:04 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Took 0.82 seconds to deallocate network for instance.
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Received event network-vif-deleted-505345c6-a079-468d-be35-64932bcaef25 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:30:59:b7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.357s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:04 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:04 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Took 2.06 seconds to deallocate network for instance.
Nov 28 06:47:05 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.680s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:05 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Deleted allocations for instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:05 user nova-compute[74870]: INFO nova.compute.manager [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Took 0.91 seconds to detach 1 volumes for instance.
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] No waiting events found dispatching network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:05 user nova-compute[74870]: WARNING nova.compute.manager [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received unexpected event network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance with vm_state active and task_state None.
Nov 28 06:47:05 user nova-compute[74870]: DEBUG nova.compute.manager [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Received event network-vif-deleted-717f616f-b485-4c7e-83be-a80086c19692 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:06 user nova-compute[74870]: INFO nova.compute.manager [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Detaching volume 5fb72480-0480-4bd1-b99b-437dbcddc280
Nov 28 06:47:06 user nova-compute[74870]: INFO nova.virt.block_device [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Attempting to driver detach volume 5fb72480-0480-4bd1-b99b-437dbcddc280 from mountpoint /dev/vdb
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Attempting to detach device vdb from instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:47:06 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:47:06 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 06:47:06 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:47:06 user nova-compute[74870]:   <serial>5fb72480-0480-4bd1-b99b-437dbcddc280</serial>
Nov 28 06:47:06 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:47:06 user nova-compute[74870]: </disk>
Nov 28 06:47:06 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:47:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully detached device vdb from instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa from the persistent domain config.
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:47:06 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:47:06 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 06:47:06 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:47:06 user nova-compute[74870]:   <serial>5fb72480-0480-4bd1-b99b-437dbcddc280</serial>
Nov 28 06:47:06 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:47:06 user nova-compute[74870]: </disk>
Nov 28 06:47:06 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:06 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Deleted allocations for instance 41240cc1-28a3-4685-9f80-68f5e37945b7
Nov 28 06:47:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "41240cc1-28a3-4685-9f80-68f5e37945b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.423s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:47:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:13 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:13 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-changed-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Refreshing instance network info cache due to event network-changed-3910f97d-105a-4142-a3ab-effc57185190. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Acquiring lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Acquired lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Refreshing network info cache for port 3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:15 user nova-compute[74870]: INFO nova.compute.manager [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Terminating instance
Nov 28 06:47:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:16 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb3a1360-d402-4962-9b05-ca0288480b10 is timed out.
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-vif-unplugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] No waiting events found dispatching network-vif-unplugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-vif-unplugged-3910f97d-105a-4142-a3ab-effc57185190 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:47:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Successfully detached device vdb from instance cb3a1360-d402-4962-9b05-ca0288480b10 from the live domain config.
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqcOCUhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:16 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0687b8-96d4-4124-9ec4-fe336f2b9aa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:47:16 user nova-compute[74870]: No targets found.
Nov 28 06:47:16 user nova-compute[74870]: iSNS:
Nov 28 06:47:16 user nova-compute[74870]: No targets found.
Nov 28 06:47:16 user nova-compute[74870]: STATIC:
Nov 28 06:47:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280
Nov 28 06:47:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:47:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:16 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3
Nov 28 06:47:16 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:16 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:16 user nova-compute[74870]: FIRMWARE:
Nov 28 06:47:16 user nova-compute[74870]: No targets found.
Nov 28 06:47:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:47:16 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:47:16 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3472c-c215-48f3-af39-540c1aed9081]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7de346-5140-4e94-8dd8-6aa4f4a8fc22]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:16 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:16 user nova-compute[74870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)
Nov 28 06:47:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:16 user nova-compute[74870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 (non-flash)
Nov 28 06:47:16 user nova-compute[74870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)
Nov 28 06:47:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef4139240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e458c8-baee-4958-b96e-7f41cd9a7989]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c94e10-33e7-44b1-97f4-79979e67e6d4]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb6636-8952-474a-a579-0d5336b92013]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[838f68ee-a568-490d-afc2-e10ded591bad]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128e225-5891-4a3b-b9f9-c5a9baf85e78]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updated VIF entry in instance network info cache for port 3910f97d-105a-4142-a3ab-effc57185190. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updating instance_info_cache with network_info: [{"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Releasing lock "refresh_cache-8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bcd0fb-c64a-48c8-96f7-8bfd34e2010d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260]
Nov 28 06:47:16 user nova-compute[74870]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3, portal: 172.16.0.220,3260] successful.
Nov 28 06:47:16 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cf45f7-d5e5-4e17-82bf-581233d29ba3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75142fc5-70f5-4c75-9e13-8f4bc41cf9a3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] <== disconnect_volume: return (346ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:47:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Instance destroyed successfully.
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'resources' on Instance uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-797277048',display_name='tempest-TestStampPattern-server-797277048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-797277048',id=14,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A==',key_name='tempest-TestStampPattern-1173073735',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48cff8da56da484d9dfee1b8118474b9',ramdisk_id='',reservation_id='r-w1mi775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-415121645',owner_user_name='tempest-TestStampPattern-415121645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:43:17Z,user_data=None,user_id='73373ee05e1b4e09b5c0870750a77262',uuid=8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converting VIF {"id": "3910f97d-105a-4142-a3ab-effc57185190", "address": "fa:16:3e:ba:9d:ef", "network": {"id": "a116c7b1-1d5c-4fc1-8589-714e935c8b89", "bridge": "br-int", "label": "tempest-TestStampPattern-957437916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48cff8da56da484d9dfee1b8118474b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3910f97d-10", "ovs_interfaceid": "3910f97d-105a-4142-a3ab-effc57185190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG os_vif [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3910f97d-10, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c488e569-602b-41f1-9e12-10f3b7e83784) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:16 user nova-compute[74870]: INFO os_vif [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:9d:ef,bridge_name='br-int',has_traffic_filtering=True,id=3910f97d-105a-4142-a3ab-effc57185190,network=Network(a116c7b1-1d5c-4fc1-8589-714e935c8b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3910f97d-10')
Nov 28 06:47:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Deleting instance files /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5_del
Nov 28 06:47:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Deletion of /opt/stack/data/nova/instances/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5_del complete
Nov 28 06:47:16 user nova-compute[74870]: INFO nova.compute.manager [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 06:47:16 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:47:16 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:17 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Took 0.52 seconds to deallocate network for instance.
Nov 28 06:47:17 user nova-compute[74870]: DEBUG nova.objects.instance [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lazy-loading 'flavor' on Instance uuid cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-vif-deleted-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:18 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Deleted allocations for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received event network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Acquiring lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] No waiting events found dispatching network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:18 user nova-compute[74870]: WARNING nova.compute.manager [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Received unexpected event network-vif-plugged-3910f97d-105a-4142-a3ab-effc57185190 for instance with vm_state deleted and task_state None.
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:47:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:47:19 user nova-compute[74870]: INFO nova.compute.claims [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Claim successful on node user
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:47:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.policy [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:47:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:47:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Creating image(s)
Nov 28 06:47:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Successfully created port: e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk 1073741824" returned: 0 in 0.109s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.225s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Cannot resize image /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Ensure instance console log exists: /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Successfully updated port: e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquired lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-changed-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Refreshing instance network info cache due to event network-changed-e51be746-1419-4a95-8bc6-bcf4ed942927. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Acquiring lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Releasing lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Instance network_info: |[{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Acquired lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Refreshing network info cache for port e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Start _get_guest_xml network_info=[{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:47:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:47:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:47:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'pci_devices' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:47:22 user nova-compute[74870]:   <uuid>75046337-1afd-4458-a305-9922679ce7e3</uuid>
Nov 28 06:47:22 user nova-compute[74870]:   <name>instance-0000001c</name>
Nov 28 06:47:22 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:47:22 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:47:22 user nova-compute[74870]:   <metadata>
Nov 28 06:47:22 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:47:22 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:47:22 user nova-compute[74870]:       <nova:name>tempest-device-tagging-server-1048812053</nova:name>
Nov 28 06:47:22 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:47:21</nova:creationTime>
Nov 28 06:47:22 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:47:22 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:47:22 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:47:22 user nova-compute[74870]:       <nova:owner>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:user uuid="dde6b091a2134b83806602165f723ade">tempest-TaggedAttachmentsTest-2015143516-project-member</nova:user>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:project uuid="898c9652da6145af82836b639c44458d">tempest-TaggedAttachmentsTest-2015143516</nova:project>
Nov 28 06:47:22 user nova-compute[74870]:       </nova:owner>
Nov 28 06:47:22 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:47:22 user nova-compute[74870]:       <nova:ports>
Nov 28 06:47:22 user nova-compute[74870]:         <nova:port uuid="e51be746-1419-4a95-8bc6-bcf4ed942927">
Nov 28 06:47:22 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 06:47:22 user nova-compute[74870]:         </nova:port>
Nov 28 06:47:22 user nova-compute[74870]:       </nova:ports>
Nov 28 06:47:22 user nova-compute[74870]:     </nova:instance>
Nov 28 06:47:22 user nova-compute[74870]:   </metadata>
Nov 28 06:47:22 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:47:22 user nova-compute[74870]:     <system>
Nov 28 06:47:22 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:47:22 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:47:22 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:47:22 user nova-compute[74870]:       <entry name="serial">75046337-1afd-4458-a305-9922679ce7e3</entry>
Nov 28 06:47:22 user nova-compute[74870]:       <entry name="uuid">75046337-1afd-4458-a305-9922679ce7e3</entry>
Nov 28 06:47:22 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:47:22 user nova-compute[74870]:     </system>
Nov 28 06:47:22 user nova-compute[74870]:   </sysinfo>
Nov 28 06:47:22 user nova-compute[74870]:   <os>
Nov 28 06:47:22 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:47:22 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:47:22 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:47:22 user nova-compute[74870]:   </os>
Nov 28 06:47:22 user nova-compute[74870]:   <features>
Nov 28 06:47:22 user nova-compute[74870]:     <acpi/>
Nov 28 06:47:22 user nova-compute[74870]:     <apic/>
Nov 28 06:47:22 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:47:22 user nova-compute[74870]:   </features>
Nov 28 06:47:22 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:47:22 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:47:22 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:47:22 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:47:22 user nova-compute[74870]:   </clock>
Nov 28 06:47:22 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:47:22 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:47:22 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:47:22 user nova-compute[74870]:   </cpu>
Nov 28 06:47:22 user nova-compute[74870]:   <devices>
Nov 28 06:47:22 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:47:22 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:47:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk"/>
Nov 28 06:47:22 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:47:22 user nova-compute[74870]:     </disk>
Nov 28 06:47:22 user nova-compute[74870]:     <disk type="file" device="cdrom">
Nov 28 06:47:22 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 06:47:22 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.config"/>
Nov 28 06:47:22 user nova-compute[74870]:       <target dev="hda" bus="ide"/>
Nov 28 06:47:22 user nova-compute[74870]:     </disk>
Nov 28 06:47:22 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:47:22 user nova-compute[74870]:       <mac address="fa:16:3e:5a:8e:ad"/>
Nov 28 06:47:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:47:22 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:47:22 user nova-compute[74870]:       <target dev="tape51be746-14"/>
Nov 28 06:47:22 user nova-compute[74870]:     </interface>
Nov 28 06:47:22 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:47:22 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/console.log" append="off"/>
Nov 28 06:47:22 user nova-compute[74870]:     </serial>
Nov 28 06:47:22 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:47:22 user nova-compute[74870]:     <video>
Nov 28 06:47:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:47:22 user nova-compute[74870]:     </video>
Nov 28 06:47:22 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:47:22 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:47:22 user nova-compute[74870]:     </rng>
Nov 28 06:47:22 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:47:22 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:47:22 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:47:22 user nova-compute[74870]:     </memballoon>
Nov 28 06:47:22 user nova-compute[74870]:   </devices>
Nov 28 06:47:22 user nova-compute[74870]: </domain>
Nov 28 06:47:22 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG os_vif [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6746f584-5d18-5900-9b9c-7d2eb85fef18', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape51be746-14, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape51be746-14, col_values=(('qos', UUID('bc039804-1c4a-46f6-b4a5-4c0fe3c27b9f')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape51be746-14, col_values=(('external_ids', {'iface-id': 'e51be746-1419-4a95-8bc6-bcf4ed942927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:8e:ad', 'vm-uuid': '75046337-1afd-4458-a305-9922679ce7e3'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:22 user nova-compute[74870]: INFO os_vif [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14')
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:47:22 user nova-compute[74870]: INFO nova.compute.claims [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Claim successful on node user
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No BDM found with device name hda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No VIF found with MAC fa:16:3e:5a:8e:ad, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:47:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Using config drive
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Creating config drive at /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.config
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe44xe_mi {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe44xe_mi" returned: 0 in 0.051s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updated VIF entry in instance network info cache for port e51be746-1419-4a95-8bc6-bcf4ed942927. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Releasing lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:26 user nova-compute[74870]: WARNING nova.compute.manager [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 for instance with vm_state building and task_state spawning.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:26 user nova-compute[74870]: WARNING nova.compute.manager [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 for instance with vm_state building and task_state spawning.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:47:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Instance spawned successfully.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:47:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:47:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7256MB free_disk=25.313735961914062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.948s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.069s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:47:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:47:26 user nova-compute[74870]: INFO nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance cb3a1360-d402-4962-9b05-ca0288480b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 75046337-1afd-4458-a305-9922679ce7e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance c7a2db07-1739-4fa5-b444-86d602ca586f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:47:26 user nova-compute[74870]: INFO nova.virt.block_device [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Booting with volume 23c0c714-f163-4492-af6c-f07ed4e57c74 at /dev/vda
Nov 28 06:47:26 user nova-compute[74870]: INFO nova.compute.manager [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Took 7.35 seconds to build instance.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.503s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.policy [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.utils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ccdb66-b43d-4f0e-92e3-dc3db15e6eea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5059c1ed-5233-47fa-8967-290fa7a0001c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c39171-734d-4f8c-ae5f-6e85314cdd6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f3eb7a-f991-4957-953e-e3350357b181]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:26 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e0c3d7-6119-4079-991d-4dfa096a0dec]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.utils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating existing volume attachment record: 5c5b2737-f413-47be-b635-23f136f52e8e {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:47:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa is timed out.
Nov 28 06:47:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully detached device vdb from instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa from the live domain config.
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BxjkRIKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:26 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c1f67-7820-4958-b2f3-810904157c90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:47:26 user nova-compute[74870]: No targets found.
Nov 28 06:47:26 user nova-compute[74870]: iSNS:
Nov 28 06:47:26 user nova-compute[74870]: No targets found.
Nov 28 06:47:26 user nova-compute[74870]: STATIC:
Nov 28 06:47:26 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280
Nov 28 06:47:26 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:26 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:26 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:47:26 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:47:26 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:47:26 user nova-compute[74870]: FIRMWARE:
Nov 28 06:47:26 user nova-compute[74870]: No targets found.
Nov 28 06:47:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:47:26 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:47:26 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2496c5f1-dbb3-4d8b-8ea4-bcaee5332b2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4299ce-75d6-40a0-89ea-9127d1fcc399]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:26 user nova-compute[74870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)
Nov 28 06:47:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:26 user nova-compute[74870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 (non-flash)
Nov 28 06:47:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7ddb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5dbc89-c6a8-494d-baaa-303c1e272df4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad762e9-9beb-4825-899c-48d9afbd4d20]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f686fde5-2dbb-4105-b7f5-4d9b413d8f76]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e08417-a83a-4344-bfe4-9e19653b7a55]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dadbfcf-82c2-4546-b44d-bafd22cb6d1e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01698a7-2ab9-4814-a739-6fafbb07ae39]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260]
Nov 28 06:47:27 user nova-compute[74870]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280, portal: 172.16.0.220,3260] successful.
Nov 28 06:47:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully created port: ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fb72480-0480-4bd1-b99b-437dbcddc280 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5180af-eb43-4cc3-93b9-90ff6c591104]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== disconnect_volume: return (355ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully created port: 0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-changed-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Refreshing instance network info cache due to event network-changed-d20c570c-280d-472a-a11a-3e13c3920461. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Acquiring lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Acquired lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Refreshing network info cache for port d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully created port: 40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updated VIF entry in instance network info cache for port d20c570c-280d-472a-a11a-3e13c3920461. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Releasing lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Skipping network cache update for instance because it is Building. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 06:47:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully created port: 8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [{"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-37549ec7-6ded-412f-8a4f-58a7469e4cd1" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:47:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully created port: c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-ce346bd0-6d5d-45d0-9165-4da3207ce081. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: 57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG nova.objects.instance [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:31 user nova-compute[74870]: INFO nova.compute.manager [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Attaching volume 142a655f-e1de-4c08-b7e5-e81e50cf760f to /dev/vdb
Nov 28 06:47:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG os_brick.utils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: 7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51c302f-5b31-42ec-aa3d-60f53f036c65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349556a-fccd-40e9-b787-7e08ffc472f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52d66b6-c795-41e4-8ed0-680ff58e6c5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa667fd-f773-4716-bb79-80b15dbc4634]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:32 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65a9e0-0f89-4c48-9edb-400845f4fd35]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG os_brick.utils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating existing volume attachment record: 81ae0592-be58-4f89-9e90-bfce31d56fce {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-57870541-c5b7-4cd3-9836-64b4ee4ffb81. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port 57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: 0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:47:32 user nova-compute[74870]: DEBUG nova.network.neutron [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-7a5dfb04-4a6f-4704-9885-d38d223aeae6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port 7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: 40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: 8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Successfully updated port: c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-0314f996-11e4-4335-8088-c85a9ec88931. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:47:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-c1a310b8-79bf-4098-a7f8-0f1736c5dd79. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance network_info: |[{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port 0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updated VIF entry in instance network info cache for port 0314f996-11e4-4335-8088-c85a9ec88931. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-40d74d10-744b-4187-8a27-c72bfc4b1a47. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:37 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port 40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updated VIF entry in instance network info cache for port 40d74d10-744b-4187-8a27-c72bfc4b1a47. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port 8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:38 user nova-compute[74870]: INFO nova.virt.block_device [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Booting with volume 96aa8851-3cdf-43b9-a69e-891d458bf78b at /dev/vdb
Nov 28 06:47:38 user nova-compute[74870]: DEBUG os_brick.utils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42e9467-eb71-4340-adf3-0d7237873415]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb52434b-28f2-4cae-9c9b-e2b468fbe223]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fbde5b-0594-4979-aedc-e1c46d9a338b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc0c67-fd1a-4b36-945b-b8f263aefafb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updated VIF entry in instance network info cache for port 8ab023f9-1a91-43d1-a020-8ecd1a6eafaf. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:38 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc61cc7-dcfb-412e-9207-f1f06a455280]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG os_brick.utils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:38 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating existing volume attachment record: f8a1e2d1-a8f9-4492-86e5-097dc2405a5d {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updated VIF entry in instance network info cache for port c1a310b8-79bf-4098-a7f8-0f1736c5dd79. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:39 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:39 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:47:40 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05713a1c-2088-4146-8872-d24bc5ee1906]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:47:40 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8892ab5b-611d-470d-b77d-c782f004239c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f] added
Nov 28 06:47:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.087s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74bcad0-d926-4f2a-bd77-3aed182e9a1e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21abb0f-4326-40d4-90c1-ab5528b7f992]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UumbSJsz {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UumbSJsz" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fee24b-7c88-4b41-9fc4-910fa61f3b3e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UumbSJsz'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b618a-2c64-4a28-82d9-8bd61fd5c6f1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a0c13f-60df-4eb4-b8ba-31eaaa9f2a45]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e46d948-1281-49ec-8527-2a4df123ab75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]
Nov 28 06:47:40 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.
Nov 28 06:47:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[920bc234-cddd-48c2-aee1-b5987b4422d7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[425bab5b-6cf0-43c4-8373-f082aeecd58d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:40 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:47:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:47:40 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:47:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fe4004-ac72-4140-9a3e-8a6d5c81dde3]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23030623065313361', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030623065313361', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG nova.objects.instance [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:47:41 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:47:41 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 06:47:41 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:47:41 user nova-compute[74870]:   <serial>142a655f-e1de-4c08-b7e5-e81e50cf760f</serial>
Nov 28 06:47:41 user nova-compute[74870]: </disk>
Nov 28 06:47:41 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:47:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No VIF found with MAC fa:16:3e:88:f4:5c, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:47:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.069s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74870) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:43 user nova-compute[74870]: WARNING nova.compute.manager [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state active and task_state powering-off.
Nov 28 06:47:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance destroyed successfully.
Nov 28 06:47:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:47:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.933s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:45 user nova-compute[74870]: WARNING nova.compute.manager [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state stopped and task_state None.
Nov 28 06:47:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:49 user nova-compute[74870]: INFO nova.virt.block_device [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Booting with volume 285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 at /dev/vdc
Nov 28 06:47:49 user nova-compute[74870]: DEBUG os_brick.utils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54074e0-9933-4d7e-9c60-82cde3110f51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd6ff5-15ee-4776-817e-1e76ad7923fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc82efc-50f2-43af-8344-b7635ec70135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[be556706-4916-499b-9129-2a7f4edb49ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:47:49 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:47:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6baefb0-2fce-48eb-b216-8d28943cb4df]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG os_brick.utils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:47:49 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating existing volume attachment record: 9694b70b-0d9f-4116-a77f-3cf717d6eb8d {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:50 user nova-compute[74870]: INFO nova.compute.manager [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Terminating instance
Nov 28 06:47:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-vif-unplugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] No waiting events found dispatching network-vif-unplugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-vif-unplugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:47:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Instance destroyed successfully.
Nov 28 06:47:51 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lazy-loading 'resources' on Instance uuid cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1285664',id=22,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr34jTxAgvpieMtESUKF9pO7y0EurVjqQ9xjdMeLwnzjkjuKNQ7iJVoSBKNvYBZIPKIBEj492DjxQnvCzD9J0jWg2c7JEs+zpI2+Oeup3XvLPpb0ZWo5Jl60bq3TCKyvA==',key_name='tempest-keypair-676620164',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:44:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bc4dd85b0ff45bd8e13a8266b18b843',ramdisk_id='',reservation_id='r-76erjnuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-296558585',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cff054e141e43feb19997a67027f5bc',uuid=cb3a1360-d402-4962-9b05-ca0288480b10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Converting VIF {"id": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "address": "fa:16:3e:24:7d:ef", "network": {"id": "e43b9224-8ed8-407f-9685-ee32b4909c3b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-797244280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bc4dd85b0ff45bd8e13a8266b18b843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89c6a82-52", "ovs_interfaceid": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG os_vif [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa89c6a82-52, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1115fce3-6399-4c6c-9ad8-6912ba7fc79b) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:51 user nova-compute[74870]: INFO os_vif [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:7d:ef,bridge_name='br-int',has_traffic_filtering=True,id=a89c6a82-52b2-4afa-b8e5-01cf52d7bb27,network=Network(e43b9224-8ed8-407f-9685-ee32b4909c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89c6a82-52')
Nov 28 06:47:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Deleting instance files /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10_del
Nov 28 06:47:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Deletion of /opt/stack/data/nova/instances/cb3a1360-d402-4962-9b05-ca0288480b10_del complete
Nov 28 06:47:51 user nova-compute[74870]: INFO nova.compute.manager [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 06:47:51 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:47:51 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:52 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Took 0.79 seconds to deallocate network for instance.
Nov 28 06:47:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-vif-deleted-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:52 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Deleted allocations for instance cb3a1360-d402-4962-9b05-ca0288480b10
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "cb3a1360-d402-4962-9b05-ca0288480b10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received event network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Acquiring lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Lock "cb3a1360-d402-4962-9b05-ca0288480b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] No waiting events found dispatching network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:52 user nova-compute[74870]: WARNING nova.compute.manager [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Received unexpected event network-vif-plugged-a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance with vm_state deleted and task_state None.
Nov 28 06:47:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:56 user nova-compute[74870]: INFO nova.compute.manager [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Terminating instance
Nov 28 06:47:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-vif-unplugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] No waiting events found dispatching network-vif-unplugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.compute.manager [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-vif-unplugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:47:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Instance destroyed successfully.
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.objects.instance [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'resources' on Instance uuid 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-875010330',display_name='tempest-AttachVolumeNegativeTest-server-875010330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-875010330',id=23,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb8WB6ij2s6GSTONUry95+XZmirnDSuGCLeYTlWhJo5pt46o5jzKSFOUsahma8KL6J42jbZN/OQdWkzrX5NrqDyqs21eSDp1KFumAwGYgOU0L1gYwgX4rEZDxatlltO6w==',key_name='tempest-keypair-1434653657',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-c2jgvuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=46e43d2c-f91b-44cb-9cfe-a0e3682a12aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "address": "fa:16:3e:30:59:b7", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4fa043b-e1", "ovs_interfaceid": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG os_vif [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4fa043b-e1, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=633976fb-3a10-4807-b4d5-10c0fb17f6f6) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:57 user nova-compute[74870]: INFO os_vif [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:59:b7,bridge_name='br-int',has_traffic_filtering=True,id=b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4fa043b-e1')
Nov 28 06:47:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Deleting instance files /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa_del
Nov 28 06:47:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Deletion of /opt/stack/data/nova/instances/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa_del complete
Nov 28 06:47:57 user nova-compute[74870]: INFO nova.compute.manager [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 06:47:57 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:47:57 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:47:58 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:47:58 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Took 0.67 seconds to deallocate network for instance.
Nov 28 06:47:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-vif-deleted-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:58 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:47:58 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:47:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:58 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Deleted allocations for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa
Nov 28 06:47:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:47:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received event network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:47:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Acquiring lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:47:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:47:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Lock "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:47:59 user nova-compute[74870]: DEBUG nova.compute.manager [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] No waiting events found dispatching network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:47:59 user nova-compute[74870]: WARNING nova.compute.manager [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Received unexpected event network-vif-plugged-b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance with vm_state deleted and task_state None.
Nov 28 06:48:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:48:05 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Creating image(s)
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Ensure instance console log exists: /opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Start _get_guest_xml network_info=[{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTFxJKdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7a2db07-1739-4fa5-b444-86d602ca586f', 'attached_at': '', 'detached_at': '', 'volume_id': '23c0c714-f163-4492-af6c-f07ed4e57c74', 'serial': '23c0c714-f163-4492-af6c-f07ed4e57c74'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '5c5b2737-f413-47be-b635-23f136f52e8e', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmvOEzkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7a2db07-1739-4fa5-b444-86d602ca586f', 'attached_at': '', 'detached_at': '', 'volume_id': '96aa8851-3cdf-43b9-a69e-891d458bf78b', 'serial': '96aa8851-3cdf-43b9-a69e-891d458bf78b'}, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'f8a1e2d1-a8f9-4492-86e5-097dc2405a5d', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEzLqtYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7a2db07-1739-4fa5-b444-86d602ca586f', 'attached_at': '', 'detached_at': '', 'volume_id': '285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7', 'serial': '285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7'}, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '9694b70b-0d9f-4116-a77f-3cf717d6eb8d', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:48:05 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:05 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTFxJKdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:05 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:05 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:05 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[966ea725-6b7b-4aa6-bc8f-873b995199b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:48:05 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[392059d5-e93f-4164-9de0-f0fd591860a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74] added
Nov 28 06:48:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea73fc82-4e3f-48d4-ab51-6506293c5b21]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99db251-bfd8-4001-960e-b8c4cd752589]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTFxJKdz {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTFxJKdz" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[622e7802-4413-48d5-ba5b-dea70a415665]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTFxJKdz'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e20be9-42d5-4e39-bfc2-a4fcf98a9d7a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b55e1e-1f61-492a-8e36-881de706d714]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:05 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:05 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[016d1a46-46c6-44c2-bf9e-5c2189728fb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260]
Nov 28 06:48:05 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c66d63d-6146-4b28-827f-57771f78cebc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578f875-092a-4f4f-be53-ee85270ddd86]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:05 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:05 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:05 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:05 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:05 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c993b803-1b60-4f12-8e0c-467321300775]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:48:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTFxJKdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26638346237306635', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638346237306635', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmvOEzkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:06 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:06 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:06 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ff4a9-5424-4146-8d91-4e25dd42efc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:48:06 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab34d66-171b-4d14-8614-a25a19109cc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b] added
Nov 28 06:48:06 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1fcc9-1d08-4b73-8543-b54b51d51614]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b969da3-de9b-4240-9329-ad078328c6aa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmvOEzkC {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmvOEzkC" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[034dfbb6-b3a2-464f-903d-8ae72858cc3c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmvOEzkC'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1f1f3-2eb0-4414-aac2-1f785e80e44d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1238a3ea-904a-4731-a0a1-ff2a9289b305]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2644d20-3100-498a-a431-9ceaae6306bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260]
Nov 28 06:48:06 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:06 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f945d5e-aff0-424a-88a6-a91af20167e3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd30326-6238-41d1-b262-0cd5e207d401]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:06 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:06 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:06 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe26a7a-02ff-4e5e-9373-16e8a28c37ec]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:48:06 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmvOEzkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26335313564393934', 'path': '/dev/sde'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335313564393934', 'path': '/dev/sde'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEzLqtYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:07 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:07 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:07 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65206c06-59ab-4533-bb40-b47018e3ccfb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:48:07 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed25992-10d1-452f-9c87-d385df4a2ff0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7] added
Nov 28 06:48:07 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[31357dc0-2c41-402b-aeb0-df55f320bd4b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:07 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74df76e-77f4-426f-9ca4-a29db3711655]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEzLqtYP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEzLqtYP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[447ba40b-5dd1-4334-912a-288f935c32ce]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wEzLqtYP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc5fc07-3307-4655-a883-b402dcd7608a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e9dfe-54bf-449f-9a22-032d497b60e1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208e48d-0f27-4ccc-87c1-bd59b607c5d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260]
Nov 28 06:48:08 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a31825c-dc0a-4189-882c-4c65d6470212]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9efae-f784-4560-8d67-cd0bfc831eb5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:08 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0bcacf-f2ef-4ee8-a4eb-42fbcd3ed1f5]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:48:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEzLqtYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26365383339623931', 'path': '/dev/sdf'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365383339623931', 'path': '/dev/sdf'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lazy-loading 'pci_devices' on Instance uuid c7a2db07-1739-4fa5-b444-86d602ca586f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:48:09 user nova-compute[74870]:   <uuid>c7a2db07-1739-4fa5-b444-86d602ca586f</uuid>
Nov 28 06:48:09 user nova-compute[74870]:   <name>instance-0000001d</name>
Nov 28 06:48:09 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:48:09 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:48:09 user nova-compute[74870]:   <metadata>
Nov 28 06:48:09 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:48:09 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:48:09 user nova-compute[74870]:       <nova:name>tempest-device-tagging-server-1427016084</nova:name>
Nov 28 06:48:09 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:48:05</nova:creationTime>
Nov 28 06:48:09 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:48:09 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:48:09 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:48:09 user nova-compute[74870]:       <nova:owner>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:user uuid="59abab1396dc462cab4cd9c945c446f5">tempest-TaggedBootDevicesTest_v242-976904504-project-member</nova:user>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:project uuid="24232ad48c7c4b6c94efc23f0682247f">tempest-TaggedBootDevicesTest_v242-976904504</nova:project>
Nov 28 06:48:09 user nova-compute[74870]:       </nova:owner>
Nov 28 06:48:09 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:48:09 user nova-compute[74870]:       <nova:ports>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="ce346bd0-6d5d-45d0-9165-4da3207ce081">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="57870541-c5b7-4cd3-9836-64b4ee4ffb81">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="7a5dfb04-4a6f-4704-9885-d38d223aeae6">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="0314f996-11e4-4335-8088-c85a9ec88931">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="40d74d10-744b-4187-8a27-c72bfc4b1a47">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="8ab023f9-1a91-43d1-a020-8ecd1a6eafaf">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:         <nova:port uuid="c1a310b8-79bf-4098-a7f8-0f1736c5dd79">
Nov 28 06:48:09 user nova-compute[74870]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 06:48:09 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:09 user nova-compute[74870]:       </nova:ports>
Nov 28 06:48:09 user nova-compute[74870]:     </nova:instance>
Nov 28 06:48:09 user nova-compute[74870]:   </metadata>
Nov 28 06:48:09 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:48:09 user nova-compute[74870]:     <system>
Nov 28 06:48:09 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:48:09 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:48:09 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:48:09 user nova-compute[74870]:       <entry name="serial">c7a2db07-1739-4fa5-b444-86d602ca586f</entry>
Nov 28 06:48:09 user nova-compute[74870]:       <entry name="uuid">c7a2db07-1739-4fa5-b444-86d602ca586f</entry>
Nov 28 06:48:09 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:48:09 user nova-compute[74870]:     </system>
Nov 28 06:48:09 user nova-compute[74870]:   </sysinfo>
Nov 28 06:48:09 user nova-compute[74870]:   <os>
Nov 28 06:48:09 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:48:09 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:48:09 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:48:09 user nova-compute[74870]:   </os>
Nov 28 06:48:09 user nova-compute[74870]:   <features>
Nov 28 06:48:09 user nova-compute[74870]:     <acpi/>
Nov 28 06:48:09 user nova-compute[74870]:     <apic/>
Nov 28 06:48:09 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:48:09 user nova-compute[74870]:   </features>
Nov 28 06:48:09 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:48:09 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:48:09 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:48:09 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:48:09 user nova-compute[74870]:   </clock>
Nov 28 06:48:09 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:48:09 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:48:09 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:48:09 user nova-compute[74870]:   </cpu>
Nov 28 06:48:09 user nova-compute[74870]:   <devices>
Nov 28 06:48:09 user nova-compute[74870]:     <disk type="file" device="cdrom">
Nov 28 06:48:09 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 06:48:09 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f/disk.config"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="hda" bus="ide"/>
Nov 28 06:48:09 user nova-compute[74870]:     </disk>
Nov 28 06:48:09 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:48:09 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:09 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <serial>23c0c714-f163-4492-af6c-f07ed4e57c74</serial>
Nov 28 06:48:09 user nova-compute[74870]:     </disk>
Nov 28 06:48:09 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:48:09 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:09 user nova-compute[74870]:       <source dev="/dev/sde"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <serial>96aa8851-3cdf-43b9-a69e-891d458bf78b</serial>
Nov 28 06:48:09 user nova-compute[74870]:     </disk>
Nov 28 06:48:09 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:48:09 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:09 user nova-compute[74870]:       <source dev="/dev/sdf"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="vdc" bus="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <serial>285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7</serial>
Nov 28 06:48:09 user nova-compute[74870]:     </disk>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:1c:7a:a8"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tapce346bd0-6d"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:ec:7e:76"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tap57870541-c5"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:12:3d:31"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tap7a5dfb04-4a"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:e1:31:1f"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tap0314f996-11"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:cc:f5:d7"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tap40d74d10-74"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:76:37:38"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tap8ab023f9-1a"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:09 user nova-compute[74870]:       <mac address="fa:16:3e:45:8f:85"/>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:09 user nova-compute[74870]:       <target dev="tapc1a310b8-79"/>
Nov 28 06:48:09 user nova-compute[74870]:     </interface>
Nov 28 06:48:09 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:48:09 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f/console.log" append="off"/>
Nov 28 06:48:09 user nova-compute[74870]:     </serial>
Nov 28 06:48:09 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:48:09 user nova-compute[74870]:     <video>
Nov 28 06:48:09 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:09 user nova-compute[74870]:     </video>
Nov 28 06:48:09 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:48:09 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:48:09 user nova-compute[74870]:     </rng>
Nov 28 06:48:09 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:48:09 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:48:09 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:48:09 user nova-compute[74870]:     </memballoon>
Nov 28 06:48:09 user nova-compute[74870]:   </devices>
Nov 28 06:48:09 user nova-compute[74870]: </domain>
Nov 28 06:48:09 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2735838f-a7f6-5421-89a2-a921cf8daae3', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce346bd0-6d, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce346bd0-6d, col_values=(('qos', UUID('d236f9f1-0f43-4942-90e6-18c0000c7b78')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce346bd0-6d, col_values=(('external_ids', {'iface-id': 'ce346bd0-6d5d-45d0-9165-4da3207ce081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:7a:a8', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d')
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '681581cf-7d50-5e54-b0c8-2ad7f7cf5544', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57870541-c5, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57870541-c5, col_values=(('qos', UUID('6bbcf677-60b3-45e6-b773-dd4cc61bfb59')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57870541-c5, col_values=(('external_ids', {'iface-id': '57870541-c5b7-4cd3-9836-64b4ee4ffb81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7e:76', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5')
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81baf507-0563-5cef-8e63-42a5f77d37cd', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a5dfb04-4a, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a5dfb04-4a, col_values=(('qos', UUID('2b9682cc-9178-4948-82a7-8f3fcc0d0dfe')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a5dfb04-4a, col_values=(('external_ids', {'iface-id': '7a5dfb04-4a6f-4704-9885-d38d223aeae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:3d:31', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a')
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f4f6c5b-5c87-5ac8-a97b-c379198f6e3c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0314f996-11, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0314f996-11, col_values=(('qos', UUID('c647856f-a09a-4bde-9303-025022cbdcca')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0314f996-11, col_values=(('external_ids', {'iface-id': '0314f996-11e4-4335-8088-c85a9ec88931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:31:1f', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11')
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b52b6e99-e7a9-5b2c-adb3-21c6ff7d11e5', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40d74d10-74, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40d74d10-74, col_values=(('qos', UUID('bb418681-f699-4c20-b483-a0c4b404fa53')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40d74d10-74, col_values=(('external_ids', {'iface-id': '40d74d10-744b-4187-8a27-c72bfc4b1a47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f5:d7', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74')
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56b294f2-e376-5208-8edf-1ea2d7b02356', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ab023f9-1a, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ab023f9-1a, col_values=(('qos', UUID('2745e24d-cb51-433a-a3b4-c3e26e7fd7fe')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ab023f9-1a, col_values=(('external_ids', {'iface-id': '8ab023f9-1a91-43d1-a020-8ecd1a6eafaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:37:38', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a')
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a95e9a3-41f8-5a0e-8885-4c183108ab52', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1a310b8-79, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1a310b8-79, col_values=(('qos', UUID('62889545-c867-447c-974b-a403317ea8cc')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1a310b8-79, col_values=(('external_ids', {'iface-id': 'c1a310b8-79bf-4098-a7f8-0f1736c5dd79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:8f:85', 'vm-uuid': 'c7a2db07-1739-4fa5-b444-86d602ca586f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:10 user nova-compute[74870]: INFO os_vif [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79')
Nov 28 06:48:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] No BDM found with device name hda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] No VIF found with MAC fa:16:3e:1c:7a:a8, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] No VIF found with MAC fa:16:3e:cc:f5:d7, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Using config drive
Nov 28 06:48:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Creating config drive at /opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f/disk.config
Nov 28 06:48:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnfvgq4rx {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnfvgq4rx" returned: 0 in 0.056s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:12 user nova-compute[74870]: WARNING nova.compute.manager [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance with vm_state building and task_state spawning.
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:13 user nova-compute[74870]: WARNING nova.compute.manager [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance with vm_state building and task_state spawning.
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:13 user nova-compute[74870]: WARNING nova.compute.manager [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 for instance with vm_state building and task_state spawning.
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:14 user nova-compute[74870]: WARNING nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance with vm_state building and task_state spawning.
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:14 user nova-compute[74870]: WARNING nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance with vm_state building and task_state spawning.
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:14 user nova-compute[74870]: WARNING nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance with vm_state building and task_state spawning.
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:14 user nova-compute[74870]: WARNING nova.compute.manager [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance with vm_state building and task_state spawning.
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:15 user nova-compute[74870]: WARNING nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance with vm_state building and task_state spawning.
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:15 user nova-compute[74870]: WARNING nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance with vm_state building and task_state spawning.
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:15 user nova-compute[74870]: WARNING nova.compute.manager [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance with vm_state building and task_state spawning.
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:15 user nova-compute[74870]: WARNING nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 for instance with vm_state building and task_state spawning.
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:15 user nova-compute[74870]: WARNING nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance with vm_state building and task_state spawning.
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:15 user nova-compute[74870]: WARNING nova.compute.manager [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance with vm_state building and task_state spawning.
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:16 user nova-compute[74870]: WARNING nova.compute.manager [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance with vm_state building and task_state spawning.
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:48:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance spawned successfully.
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:16 user nova-compute[74870]: INFO nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Took 11.60 seconds to spawn the instance on the hypervisor.
Nov 28 06:48:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:48:16 user nova-compute[74870]: INFO nova.compute.manager [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Took 54.80 seconds to build instance.
Nov 28 06:48:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.934s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:17 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'flavor' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:18 user nova-compute[74870]: INFO nova.compute.manager [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attaching volume 0ceba6e2-fc04-4dc6-ab19-055561d21e27 to /dev/vdb
Nov 28 06:48:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-changed-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Refreshing instance network info cache due to event network-changed-5a6dbf47-1250-4f02-87b4-6d33d64d34eb. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Acquiring lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Acquired lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG nova.network.neutron [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Refreshing network info cache for port 5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG os_brick.utils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a77cf-bf64-4926-8640-f762b6f0b683]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62aa2cd-b73f-40df-ad09-406629fcfc3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a7c6ff-5760-41f0-ae9c-9ed4dfbf0f32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e43ae53-3a78-416b-a8bb-4ea258ffcee1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:48:18 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:48:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb772f0e-c418-4bb4-a6d0-1af3c1dafae2]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG os_brick.utils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:18 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updating existing volume attachment record: 5de9eacf-891c-4715-850e-fbe12e13af5e {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:48:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updated VIF entry in instance network info cache for port 5a6dbf47-1250-4f02-87b4-6d33d64d34eb. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:48:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updating instance_info_cache with network_info: [{"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Releasing lock "refresh_cache-30c7dc1e-9569-49f5-aabf-a98cba6470fa" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:48:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.32162094116211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 75046337-1afd-4458-a305-9922679ce7e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance c7a2db07-1739-4fa5-b444-86d602ca586f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:48:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:48:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:48:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:48:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:48:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:27 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:27 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:27 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8fd2d4-0f3e-4ef6-9285-b1e2eb075eda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:48:27 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec5e210-aaad-4dd9-a22f-029e218ae651]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27] added
Nov 28 06:48:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a8b2d3-0c1b-442a-8297-1ef20f515248]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f947a-dd3a-4d32-9fcb-f251501cda35]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyIsqnXZ {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyIsqnXZ" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93d915-1a4d-4fe4-96ec-3dd00a601bf8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyIsqnXZ'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5120f1dd-0610-4fa4-b37b-1e2b8911b89a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24966be2-7333-4d88-a16f-5f50c1a8fcfa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4a4b4a-f519-425b-9744-1f2524c37419]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]
Nov 28 06:48:27 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[571ed6aa-b8aa-4a64-81e6-cd6f0022f052]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5d0f6-fc81-45de-8164-17bb6f2f7a3b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:48:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b191ca45-68f4-4fc3-a855-c9d4637e5a5f]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:48:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23565343236316332', 'path': '/dev/sdg'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343236316332', 'path': '/dev/sdg'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:48:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'flavor' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:48:29 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:29 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:48:29 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:48:29 user nova-compute[74870]:   <serial>0ceba6e2-fc04-4dc6-ab19-055561d21e27</serial>
Nov 28 06:48:29 user nova-compute[74870]: </disk>
Nov 28 06:48:29 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No VIF found with MAC fa:16:3e:a8:ad:04, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [{"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-94a8f46d-3105-4486-a8b4-1409c9c544c7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.544s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:31 user nova-compute[74870]: INFO nova.compute.manager [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Rebuilding instance
Nov 28 06:48:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-unplugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-unplugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:32 user nova-compute[74870]: WARNING nova.compute.manager [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-unplugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state active and task_state rebuilding.
Nov 28 06:48:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance destroyed successfully.
Nov 28 06:48:32 user nova-compute[74870]: INFO nova.compute.manager [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Detaching volume 0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:48:32 user nova-compute[74870]: INFO nova.virt.block_device [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attempting to driver detach volume 0ceba6e2-fc04-4dc6-ab19-055561d21e27 from mountpoint /dev/vdb
Nov 28 06:48:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Attempting to detach device vdb from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:48:32 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:32 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:48:32 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:48:32 user nova-compute[74870]:   <serial>0ceba6e2-fc04-4dc6-ab19-055561d21e27</serial>
Nov 28 06:48:32 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:48:32 user nova-compute[74870]: </disk>
Nov 28 06:48:32 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:48:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully detached device vdb from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa from the persistent domain config.
Nov 28 06:48:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:32 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[22056264-0714-4106-b13e-7ef829d2eb9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:48:32 user nova-compute[74870]: No targets found.
Nov 28 06:48:32 user nova-compute[74870]: iSNS:
Nov 28 06:48:32 user nova-compute[74870]: No targets found.
Nov 28 06:48:32 user nova-compute[74870]: STATIC:
Nov 28 06:48:32 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7
Nov 28 06:48:32 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:32 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:32 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:48:32 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:32 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:32 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74
Nov 28 06:48:32 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:32 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:32 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:48:32 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:32 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:32 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:48:32 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:32 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:32 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:48:32 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:32 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:32 user nova-compute[74870]: FIRMWARE:
Nov 28 06:48:32 user nova-compute[74870]: No targets found.
Nov 28 06:48:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:48:32 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:48:32 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1916f6-bfd3-416c-95de-7255e43291e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[60972394-8e52-4c2e-853b-a0c1f2bce6d3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:48:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc127eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27'): ({'sdg'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Removing single pathed devices sdg {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94843f5-0bcf-4b8e-a79f-155f9ebc2786]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5912b108-39ca-43a7-af6c-9a774d36f374]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flushing IO for device /dev/sdg {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ecbc6-3263-4791-940e-70178aaaf9d0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[287dc455-2f00-4d53-a6ad-a18d36b2c153]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec855f6-7b6f-4a2c-9603-4fef71e82df0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b875b06-3cf5-476b-9433-22232e367ae5]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]
Nov 28 06:48:33 user nova-compute[74870]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:33 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0805d5-ed98-49a0-a79f-a194799456e1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== disconnect_volume: return (366ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance destroyed successfully.
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-865386610',display_name='tempest-ServerActionsTestOtherA-server-512573953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-865386610',id=25,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ==',key_name='tempest-keypair-940347240',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-0n77xil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=30c7dc1e-9569-49f5-aabf-a98cba6470fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a6dbf47-12, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e5d6201-7ed9-4d9c-83b9-ad94f0570a3b) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:34 user nova-compute[74870]: INFO os_vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12')
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:34 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:34 user nova-compute[74870]: WARNING nova.compute.manager [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state active and task_state rebuilding.
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6955dc9-afce-44fc-a146-5918cd1483f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:48:34 user nova-compute[74870]: No targets found.
Nov 28 06:48:34 user nova-compute[74870]: iSNS:
Nov 28 06:48:34 user nova-compute[74870]: No targets found.
Nov 28 06:48:34 user nova-compute[74870]: STATIC:
Nov 28 06:48:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7
Nov 28 06:48:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:48:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74
Nov 28 06:48:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:48:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:48:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:48:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:48:34 user nova-compute[74870]: FIRMWARE:
Nov 28 06:48:34 user nova-compute[74870]: No targets found.
Nov 28 06:48:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:48:34 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:48:34 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280392b-18cb-4222-91a6-880e86af1d00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66567395-0c73-4b8d-8f89-3e88316819f2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:34 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc125b40>, {}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Disconnecting from: [] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== disconnect_volume: return (81ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:48:34 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Deleting instance files /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa_del
Nov 28 06:48:34 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Deletion of /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa_del complete
Nov 28 06:48:34 user nova-compute[74870]: INFO nova.virt.block_device [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Booting with volume 0ceba6e2-fc04-4dc6-ab19-055561d21e27 at /dev/vdb
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.utils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7288185e-ca42-415c-921b-e2528c640643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a1218-b9c4-4f0e-9540-72a2c7eb2e2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b0d9d-2582-41d8-901e-644c3009d1ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[696f417b-59cf-469f-9701-1e9803b075df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:48:34 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:48:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[926af4f6-3670-474c-947b-fa154aad1c95]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG os_brick.utils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:34 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updating existing volume attachment record: 0774bcd5-c911-4f2d-8b56-d19b93aa1132 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:48:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing instance network info cache due to event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updated VIF entry in instance network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:38 user nova-compute[74870]: INFO nova.compute.manager [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Attaching volume daa2eb88-295a-4c93-81a0-3f799e732e97 to /dev/vdb
Nov 28 06:48:38 user nova-compute[74870]: DEBUG os_brick.utils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab2474-827e-4a45-be23-76ad96f58c08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e8a8d0-70fa-46db-b2bd-f9fdf3348cdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbe2b00-2b68-4631-8656-e9fae91bc83c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac2326-501d-4d97-b36f-17cde36967f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:48:38 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:48:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5691b7e1-abb6-4bfa-b017-52ab01a56d83]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG os_brick.utils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:38 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating existing volume attachment record: 0923f8b5-1951-4f2b-a47a-a12bccfa96f5 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:48:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:48:43 user nova-compute[74870]: INFO nova.compute.manager [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] instance snapshotting
Nov 28 06:48:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Beginning live snapshot process
Nov 28 06:48:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json -f qcow2 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:48:44 user nova-compute[74870]: INFO nova.compute.claims [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Claim successful on node user
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.213s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9fdhc9aq/79cd187e8733497788c8dff3a06d2a6d.delta 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9fdhc9aq/79cd187e8733497788c8dff3a06d2a6d.delta 1073741824" returned: 0 in 0.059s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:48:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.policy [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1b878f5054743d690f01e77e7425371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55617103c9e348b3bc963810362acb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:48:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Creating image(s)
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "/opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "/opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk 1073741824" returned: 0 in 0.129s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] COPY block job progress, current cursor: 16711680 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Cannot resize image /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Ensure instance console log exists: /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 06:48:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Successfully created port: 5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:48:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9fdhc9aq/79cd187e8733497788c8dff3a06d2a6d.delta /opt/stack/data/nova/instances/snapshots/tmp9fdhc9aq/79cd187e8733497788c8dff3a06d2a6d {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9fdhc9aq/79cd187e8733497788c8dff3a06d2a6d.delta /opt/stack/data/nova/instances/snapshots/tmp9fdhc9aq/79cd187e8733497788c8dff3a06d2a6d" returned: 0 in 0.883s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Snapshot extracted, beginning image upload
Nov 28 06:48:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Successfully updated port: 5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquired lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-changed-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Refreshing instance network info cache due to event network-changed-5dce38d6-cf1d-4a63-a798-fa9bc36f7418. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Acquiring lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updating instance_info_cache with network_info: [{"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Releasing lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Instance network_info: |[{"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Acquired lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.neutron [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Refreshing network info cache for port 5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Start _get_guest_xml network_info=[{"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:48:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-368773156',display_name='tempest-TestServerVolumeAttachmentScenario-server-368773156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-368773156',id=30,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODxKF/OFbZznyIWUBEYrF6APCNw+niqepzasaoANx1P3W6SKf9cpMx/jUf/m5UakKfcm2/aZgHCrOgNhmzzwVVzs4/c9tpFTJFkpBpSq6wrMu+eS98BH7Ve1fQI0zJUKQ==',key_name='tempest-keypair-1581719119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55617103c9e348b3bc963810362acb6b',ramdisk_id='',reservation_id='r-70051wuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-406971450',owner_user_name='tempest-TestServerVolumeAttachmentScenario-406971450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1b878f5054743d690f01e77e7425371',uuid=ab422771-7c11-4074-b4a6-d793c790e813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Converting VIF {"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'pci_devices' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:48:48 user nova-compute[74870]:   <uuid>ab422771-7c11-4074-b4a6-d793c790e813</uuid>
Nov 28 06:48:48 user nova-compute[74870]:   <name>instance-0000001e</name>
Nov 28 06:48:48 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:48:48 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:48:48 user nova-compute[74870]:   <metadata>
Nov 28 06:48:48 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:48:48 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:48:48 user nova-compute[74870]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-368773156</nova:name>
Nov 28 06:48:48 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:48:48</nova:creationTime>
Nov 28 06:48:48 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:48:48 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:48:48 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:48:48 user nova-compute[74870]:       <nova:owner>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:user uuid="b1b878f5054743d690f01e77e7425371">tempest-TestServerVolumeAttachmentScenario-406971450-project-member</nova:user>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:project uuid="55617103c9e348b3bc963810362acb6b">tempest-TestServerVolumeAttachmentScenario-406971450</nova:project>
Nov 28 06:48:48 user nova-compute[74870]:       </nova:owner>
Nov 28 06:48:48 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:48:48 user nova-compute[74870]:       <nova:ports>
Nov 28 06:48:48 user nova-compute[74870]:         <nova:port uuid="5dce38d6-cf1d-4a63-a798-fa9bc36f7418">
Nov 28 06:48:48 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:48:48 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:48 user nova-compute[74870]:       </nova:ports>
Nov 28 06:48:48 user nova-compute[74870]:     </nova:instance>
Nov 28 06:48:48 user nova-compute[74870]:   </metadata>
Nov 28 06:48:48 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:48:48 user nova-compute[74870]:     <system>
Nov 28 06:48:48 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:48:48 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:48:48 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:48:48 user nova-compute[74870]:       <entry name="serial">ab422771-7c11-4074-b4a6-d793c790e813</entry>
Nov 28 06:48:48 user nova-compute[74870]:       <entry name="uuid">ab422771-7c11-4074-b4a6-d793c790e813</entry>
Nov 28 06:48:48 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:48:48 user nova-compute[74870]:     </system>
Nov 28 06:48:48 user nova-compute[74870]:   </sysinfo>
Nov 28 06:48:48 user nova-compute[74870]:   <os>
Nov 28 06:48:48 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:48:48 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:48:48 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:48:48 user nova-compute[74870]:   </os>
Nov 28 06:48:48 user nova-compute[74870]:   <features>
Nov 28 06:48:48 user nova-compute[74870]:     <acpi/>
Nov 28 06:48:48 user nova-compute[74870]:     <apic/>
Nov 28 06:48:48 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:48:48 user nova-compute[74870]:   </features>
Nov 28 06:48:48 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:48:48 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:48:48 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:48:48 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:48:48 user nova-compute[74870]:   </clock>
Nov 28 06:48:48 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:48:48 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:48:48 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:48:48 user nova-compute[74870]:   </cpu>
Nov 28 06:48:48 user nova-compute[74870]:   <devices>
Nov 28 06:48:48 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:48:48 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:48:48 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk"/>
Nov 28 06:48:48 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:48:48 user nova-compute[74870]:     </disk>
Nov 28 06:48:48 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:48 user nova-compute[74870]:       <mac address="fa:16:3e:3a:66:42"/>
Nov 28 06:48:48 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:48 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:48 user nova-compute[74870]:       <target dev="tap5dce38d6-cf"/>
Nov 28 06:48:48 user nova-compute[74870]:     </interface>
Nov 28 06:48:48 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:48:48 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/console.log" append="off"/>
Nov 28 06:48:48 user nova-compute[74870]:     </serial>
Nov 28 06:48:48 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:48:48 user nova-compute[74870]:     <video>
Nov 28 06:48:48 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:48 user nova-compute[74870]:     </video>
Nov 28 06:48:48 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:48:48 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:48:48 user nova-compute[74870]:     </rng>
Nov 28 06:48:48 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:48:48 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:48:48 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:48:48 user nova-compute[74870]:     </memballoon>
Nov 28 06:48:48 user nova-compute[74870]:   </devices>
Nov 28 06:48:48 user nova-compute[74870]: </domain>
Nov 28 06:48:48 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-368773156',display_name='tempest-TestServerVolumeAttachmentScenario-server-368773156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-368773156',id=30,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODxKF/OFbZznyIWUBEYrF6APCNw+niqepzasaoANx1P3W6SKf9cpMx/jUf/m5UakKfcm2/aZgHCrOgNhmzzwVVzs4/c9tpFTJFkpBpSq6wrMu+eS98BH7Ve1fQI0zJUKQ==',key_name='tempest-keypair-1581719119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55617103c9e348b3bc963810362acb6b',ramdisk_id='',reservation_id='r-70051wuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-406971450',owner_user_name='tempest-TestServerVolumeAttachmentScenario-406971450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1b878f5054743d690f01e77e7425371',uuid=ab422771-7c11-4074-b4a6-d793c790e813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Converting VIF {"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG os_vif [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e4d59c4-fa88-51f6-9413-393b9101452a', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dce38d6-cf, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dce38d6-cf, col_values=(('qos', UUID('213f76f6-83aa-4306-82c1-d39ca2a69ce1')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dce38d6-cf, col_values=(('external_ids', {'iface-id': '5dce38d6-cf1d-4a63-a798-fa9bc36f7418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:66:42', 'vm-uuid': 'ab422771-7c11-4074-b4a6-d793c790e813'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:48 user nova-compute[74870]: INFO os_vif [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf')
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No VIF found with MAC fa:16:3e:3a:66:42, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updated VIF entry in instance network info cache for port 5dce38d6-cf1d-4a63-a798-fa9bc36f7418. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:48:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updating instance_info_cache with network_info: [{"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Releasing lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] No waiting events found dispatching network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:50 user nova-compute[74870]: WARNING nova.compute.manager [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received unexpected event network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance with vm_state building and task_state spawning.
Nov 28 06:48:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Snapshot image upload complete
Nov 28 06:48:51 user nova-compute[74870]: INFO nova.compute.manager [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Took 7.50 seconds to snapshot the instance on the hypervisor.
Nov 28 06:48:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:48:52 user nova-compute[74870]: INFO nova.compute.claims [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Claim successful on node user
Nov 28 06:48:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] No waiting events found dispatching network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:52 user nova-compute[74870]: WARNING nova.compute.manager [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received unexpected event network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance with vm_state building and task_state spawning.
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:48:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Instance spawned successfully.
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:48:53 user nova-compute[74870]: INFO nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Took 7.73 seconds to spawn the instance on the hypervisor.
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:48:53 user nova-compute[74870]: INFO nova.compute.manager [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Took 8.92 seconds to build instance.
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.029s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.policy [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:48:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Creating image(s)
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "/opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "/opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.247s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.237s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk 1073741824" returned: 0 in 0.050s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Cannot resize image /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Ensure instance console log exists: /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Successfully created port: b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crEZRBCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:54 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[def9b4f1-cfb5-4ab1-8d99-7479efd084e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:48:54 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c838f2-1f33-491f-9e7c-9cbeae5ad14e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97] added
Nov 28 06:48:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d358437f-de77-4bb2-85dc-dfbefdadaad4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[208506ca-c8fd-48db-baf7-bd3eed988265]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crEZRBCy {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crEZRBCy" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7534b9c6-94f6-40e8-bdeb-fdc3863ad984]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crEZRBCy'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca60b8f8-de8c-4ce0-b0ff-e76ab10e03a4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[35836e19-16ad-44e2-b80a-d97b67c779bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:48:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Creating image(s)
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be7293-42db-4a45-8b0c-69185c517592]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260]
Nov 28 06:48:55 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f576a5-a2c7-4435-9cc5-49ca3565edd6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c5077d-41ba-42df-8068-c966baf7dc42]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:48:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac079c-f4e6-41da-b40d-d328ee541266]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crEZRBCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.231s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.241s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk 1073741824" returned: 0 in 0.060s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Successfully updated port: b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquired lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-changed-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Refreshing instance network info cache due to event network-changed-b7c5e041-ed7b-4c47-96b6-dbebd8356786. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Acquiring lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.220s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Cannot resize image /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Ensure instance console log exists: /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Start _get_guest_xml network_info=[{"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30c7dc1e-9569-49f5-aabf-a98cba6470fa', 'attached_at': '', 'detached_at': '', 'volume_id': '0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'serial': '0ceba6e2-fc04-4dc6-ab19-055561d21e27'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '0774bcd5-c911-4f2d-8b56-d19b93aa1132', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:48:56 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 06:48:56 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:48:56 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updating instance_info_cache with network_info: [{"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26564356436653733', 'path': '/dev/sdg'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564356436653733', 'path': '/dev/sdg'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.083s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:56 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:48:56 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Releasing lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Instance network_info: |[{"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Acquired lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.neutron [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Refreshing network info cache for port b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Start _get_guest_xml network_info=[{"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d959c-018a-4262-8664-7ddef58d358c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:48:56 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:56 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1101632916',display_name='tempest-AttachVolumeNegativeTest-server-1101632916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1101632916',id=31,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ9uweIxjBCanmmT+01e+MV5bbT1foqRxFeoxQiitX1GY9EPkJhtQPbVJG1tw3les1DVgMZDuDWvExHqyXpGGDwn9KjzAwnApDu7CqUAGqzvyLltupdS+va65XaMVonDQ==',key_name='tempest-keypair-923733588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-oef3okgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'pci_devices' on Instance uuid c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8e9d9-38e9-40af-89c9-d8543bdd2659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27] added
Nov 28 06:48:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:48:56 user nova-compute[74870]:   <uuid>c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db</uuid>
Nov 28 06:48:56 user nova-compute[74870]:   <name>instance-0000001f</name>
Nov 28 06:48:56 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:48:56 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:48:56 user nova-compute[74870]:   <metadata>
Nov 28 06:48:56 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:48:56 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:48:56 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1101632916</nova:name>
Nov 28 06:48:56 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:48:56</nova:creationTime>
Nov 28 06:48:56 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:48:56 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:48:56 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:48:56 user nova-compute[74870]:       <nova:owner>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:user uuid="05e396090c4b4a8995d8d2e66c8b3db0">tempest-AttachVolumeNegativeTest-538884229-project-member</nova:user>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:project uuid="5df9ec769206481e8dad48a6461c46ba">tempest-AttachVolumeNegativeTest-538884229</nova:project>
Nov 28 06:48:56 user nova-compute[74870]:       </nova:owner>
Nov 28 06:48:56 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:48:56 user nova-compute[74870]:       <nova:ports>
Nov 28 06:48:56 user nova-compute[74870]:         <nova:port uuid="b7c5e041-ed7b-4c47-96b6-dbebd8356786">
Nov 28 06:48:56 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:48:56 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:56 user nova-compute[74870]:       </nova:ports>
Nov 28 06:48:56 user nova-compute[74870]:     </nova:instance>
Nov 28 06:48:56 user nova-compute[74870]:   </metadata>
Nov 28 06:48:56 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:48:56 user nova-compute[74870]:     <system>
Nov 28 06:48:56 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:48:56 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:48:56 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:48:56 user nova-compute[74870]:       <entry name="serial">c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db</entry>
Nov 28 06:48:56 user nova-compute[74870]:       <entry name="uuid">c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db</entry>
Nov 28 06:48:56 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:48:56 user nova-compute[74870]:     </system>
Nov 28 06:48:56 user nova-compute[74870]:   </sysinfo>
Nov 28 06:48:56 user nova-compute[74870]:   <os>
Nov 28 06:48:56 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:48:56 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:48:56 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:48:56 user nova-compute[74870]:   </os>
Nov 28 06:48:56 user nova-compute[74870]:   <features>
Nov 28 06:48:56 user nova-compute[74870]:     <acpi/>
Nov 28 06:48:56 user nova-compute[74870]:     <apic/>
Nov 28 06:48:56 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:48:56 user nova-compute[74870]:   </features>
Nov 28 06:48:56 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:48:56 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:48:56 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:48:56 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:48:56 user nova-compute[74870]:   </clock>
Nov 28 06:48:56 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:48:56 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:48:56 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:48:56 user nova-compute[74870]:   </cpu>
Nov 28 06:48:56 user nova-compute[74870]:   <devices>
Nov 28 06:48:56 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:48:56 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:48:56 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk"/>
Nov 28 06:48:56 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:48:56 user nova-compute[74870]:     </disk>
Nov 28 06:48:56 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:56 user nova-compute[74870]:       <mac address="fa:16:3e:02:0a:ef"/>
Nov 28 06:48:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:56 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:56 user nova-compute[74870]:       <target dev="tapb7c5e041-ed"/>
Nov 28 06:48:56 user nova-compute[74870]:     </interface>
Nov 28 06:48:56 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:48:56 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/console.log" append="off"/>
Nov 28 06:48:56 user nova-compute[74870]:     </serial>
Nov 28 06:48:56 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:48:56 user nova-compute[74870]:     <video>
Nov 28 06:48:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:56 user nova-compute[74870]:     </video>
Nov 28 06:48:56 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:48:56 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:48:56 user nova-compute[74870]:     </rng>
Nov 28 06:48:56 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:48:56 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:48:56 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:48:56 user nova-compute[74870]:     </memballoon>
Nov 28 06:48:56 user nova-compute[74870]:   </devices>
Nov 28 06:48:56 user nova-compute[74870]: </domain>
Nov 28 06:48:56 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1101632916',display_name='tempest-AttachVolumeNegativeTest-server-1101632916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1101632916',id=31,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ9uweIxjBCanmmT+01e+MV5bbT1foqRxFeoxQiitX1GY9EPkJhtQPbVJG1tw3les1DVgMZDuDWvExHqyXpGGDwn9KjzAwnApDu7CqUAGqzvyLltupdS+va65XaMVonDQ==',key_name='tempest-keypair-923733588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-oef3okgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_vif [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d3b17fe-e73f-5c60-ba5b-6a98892a3e95', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:48:56 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:56 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:48:56 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:48:56 user nova-compute[74870]:   <serial>daa2eb88-295a-4c93-81a0-3f799e732e97</serial>
Nov 28 06:48:56 user nova-compute[74870]: </disk>
Nov 28 06:48:56 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b97df2-e35f-4e46-b452-7f6248d5412b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c5e041-ed, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7c5e041-ed, col_values=(('qos', UUID('de6b6c8e-2bb4-4247-8c35-0898c4e82a03')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7c5e041-ed, col_values=(('external_ids', {'iface-id': 'b7c5e041-ed7b-4c47-96b6-dbebd8356786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:0a:ef', 'vm-uuid': 'c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82893f3-3938-4502-878c-3234b219d51c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyIsqnXZ {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:56 user nova-compute[74870]: INFO os_vif [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed')
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyIsqnXZ" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52198373-09c0-4b0f-80c3-ea2e6f3a235f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyIsqnXZ'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf6e7f7-461a-4ef1-8195-46c02e11f7d6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:02:0a:ef, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23abc0-3f83-45bf-9dc3-870398f610a7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92564115-7887-4092-a056-ea2a5487bc9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]
Nov 28 06:48:56 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.
Nov 28 06:48:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[783263cc-a7b7-4feb-922e-07aa379a5209]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[078683a7-9a33-4556-bd91-19baeb8f0605]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:48:56 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.532s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[32026446-c389-4e08-a1b3-0918e1f2e6a2]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.neutron [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updated VIF entry in instance network info cache for port b7c5e041-ed7b-4c47-96b6-dbebd8356786. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:48:56 user nova-compute[74870]: DEBUG nova.network.neutron [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updating instance_info_cache with network_info: [{"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Releasing lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:e7:56:7b, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.690s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.597s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== connect_volume: return (1681ms) {'type': 'block', 'scsi_wwn': '23565343236316332', 'path': '/dev/sdh'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343236316332', 'path': '/dev/sdh'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-865386610',display_name='tempest-ServerActionsTestOtherA-server-512573953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-865386610',id=25,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ==',key_name='tempest-keypair-940347240',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-0n77xil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=30c7dc1e-9569-49f5-aabf-a98cba6470fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:48:57 user nova-compute[74870]:   <uuid>30c7dc1e-9569-49f5-aabf-a98cba6470fa</uuid>
Nov 28 06:48:57 user nova-compute[74870]:   <name>instance-00000019</name>
Nov 28 06:48:57 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:48:57 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:48:57 user nova-compute[74870]:   <metadata>
Nov 28 06:48:57 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:48:57 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:48:57 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherA-server-512573953</nova:name>
Nov 28 06:48:57 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:48:56</nova:creationTime>
Nov 28 06:48:57 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:48:57 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:48:57 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:48:57 user nova-compute[74870]:       <nova:owner>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:user uuid="b7b9a26798e14399ac1a70568432485e">tempest-ServerActionsTestOtherA-1541374155-project-member</nova:user>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:project uuid="ccf9caaf7cab4c0eb3343ea2c2501481">tempest-ServerActionsTestOtherA-1541374155</nova:project>
Nov 28 06:48:57 user nova-compute[74870]:       </nova:owner>
Nov 28 06:48:57 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:48:57 user nova-compute[74870]:       <nova:ports>
Nov 28 06:48:57 user nova-compute[74870]:         <nova:port uuid="5a6dbf47-1250-4f02-87b4-6d33d64d34eb">
Nov 28 06:48:57 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 06:48:57 user nova-compute[74870]:         </nova:port>
Nov 28 06:48:57 user nova-compute[74870]:       </nova:ports>
Nov 28 06:48:57 user nova-compute[74870]:     </nova:instance>
Nov 28 06:48:57 user nova-compute[74870]:   </metadata>
Nov 28 06:48:57 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:48:57 user nova-compute[74870]:     <system>
Nov 28 06:48:57 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:48:57 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:48:57 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:48:57 user nova-compute[74870]:       <entry name="serial">30c7dc1e-9569-49f5-aabf-a98cba6470fa</entry>
Nov 28 06:48:57 user nova-compute[74870]:       <entry name="uuid">30c7dc1e-9569-49f5-aabf-a98cba6470fa</entry>
Nov 28 06:48:57 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:48:57 user nova-compute[74870]:     </system>
Nov 28 06:48:57 user nova-compute[74870]:   </sysinfo>
Nov 28 06:48:57 user nova-compute[74870]:   <os>
Nov 28 06:48:57 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:48:57 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:48:57 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:48:57 user nova-compute[74870]:   </os>
Nov 28 06:48:57 user nova-compute[74870]:   <features>
Nov 28 06:48:57 user nova-compute[74870]:     <acpi/>
Nov 28 06:48:57 user nova-compute[74870]:     <apic/>
Nov 28 06:48:57 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:48:57 user nova-compute[74870]:   </features>
Nov 28 06:48:57 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:48:57 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:48:57 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:48:57 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:48:57 user nova-compute[74870]:   </clock>
Nov 28 06:48:57 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:48:57 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:48:57 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:48:57 user nova-compute[74870]:   </cpu>
Nov 28 06:48:57 user nova-compute[74870]:   <devices>
Nov 28 06:48:57 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:48:57 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:48:57 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk"/>
Nov 28 06:48:57 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:48:57 user nova-compute[74870]:     </disk>
Nov 28 06:48:57 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:48:57 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:48:57 user nova-compute[74870]:       <source dev="/dev/sdh"/>
Nov 28 06:48:57 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:48:57 user nova-compute[74870]:       <serial>0ceba6e2-fc04-4dc6-ab19-055561d21e27</serial>
Nov 28 06:48:57 user nova-compute[74870]:     </disk>
Nov 28 06:48:57 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:48:57 user nova-compute[74870]:       <mac address="fa:16:3e:a8:ad:04"/>
Nov 28 06:48:57 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:57 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:48:57 user nova-compute[74870]:       <target dev="tap5a6dbf47-12"/>
Nov 28 06:48:57 user nova-compute[74870]:     </interface>
Nov 28 06:48:57 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:48:57 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/console.log" append="off"/>
Nov 28 06:48:57 user nova-compute[74870]:     </serial>
Nov 28 06:48:57 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:48:57 user nova-compute[74870]:     <video>
Nov 28 06:48:57 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:48:57 user nova-compute[74870]:     </video>
Nov 28 06:48:57 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:48:57 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:48:57 user nova-compute[74870]:     </rng>
Nov 28 06:48:57 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:48:57 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:48:57 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:48:57 user nova-compute[74870]:     </memballoon>
Nov 28 06:48:57 user nova-compute[74870]:   </devices>
Nov 28 06:48:57 user nova-compute[74870]: </domain>
Nov 28 06:48:57 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-865386610',display_name='tempest-ServerActionsTestOtherA-server-512573953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-865386610',id=25,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ==',key_name='tempest-keypair-940347240',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-0n77xil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=30c7dc1e-9569-49f5-aabf-a98cba6470fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG os_vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cf04eb3-8486-5fab-a408-2e27c443c1d4', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a6dbf47-12, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a6dbf47-12, col_values=(('qos', UUID('e06e4059-2b9e-4b3a-96d7-3e74aad1b2dc')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a6dbf47-12, col_values=(('external_ids', {'iface-id': '5a6dbf47-1250-4f02-87b4-6d33d64d34eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ad:04', 'vm-uuid': '30c7dc1e-9569-49f5-aabf-a98cba6470fa'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: INFO os_vif [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12')
Nov 28 06:48:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No VIF found with MAC fa:16:3e:a8:ad:04, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:58 user nova-compute[74870]: INFO nova.compute.manager [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Rescuing
Nov 28 06:48:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:48:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] No waiting events found dispatching network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:48:58 user nova-compute[74870]: WARNING nova.compute.manager [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received unexpected event network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance with vm_state building and task_state spawning.
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:48:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance destroyed successfully.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Attempting rescue
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] No waiting events found dispatching network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:01 user nova-compute[74870]: WARNING nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received unexpected event network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance with vm_state building and task_state spawning.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:01 user nova-compute[74870]: WARNING nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state rescuing.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:01 user nova-compute[74870]: WARNING nova.compute.manager [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state rescuing.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:49:01 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Creating image(s)
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'trusted_certs' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:01 user nova-compute[74870]: WARNING nova.compute.manager [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state active and task_state rebuild_spawning.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.246s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue" returned: 0 in 0.067s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'migration_context' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.base [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<de112cbb-849e-43c1-961a-4457585f2e9a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Start _get_guest_xml network_info=[{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:e7:56:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'resources' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.base [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<de112cbb-849e-43c1-961a-4457585f2e9a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'numa_topology' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.base [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<de112cbb-849e-43c1-961a-4457585f2e9a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:01 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:49:01 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'vcpu_model' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.base [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<de112cbb-849e-43c1-961a-4457585f2e9a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621425112',display_name='tempest-ServerRescueNegativeTestJSON-server-1621425112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621425112',id=26,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCT7W9jPmL2DNpNb9OOlPJ8LYFXcuPwkRJcaH1BxAIpcqXX2ZN2vfpsNvMAsDzCxKGMuLnCMHJxT/KP2cJ3GsZiR1qHhSqRW1ZO6lSQzJztb7FbdXbjL1GzTWYUBOtmlQ==',key_name='tempest-keypair-2000231521',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:46:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-pcfpikup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=de112cbb-849e-43c1-961a-4457585f2e9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:e7:56:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "vif_mac": "fa:16:3e:e7:56:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'pci_devices' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.objects.base [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Object Instance<de112cbb-849e-43c1-961a-4457585f2e9a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:49:01 user nova-compute[74870]:   <uuid>de112cbb-849e-43c1-961a-4457585f2e9a</uuid>
Nov 28 06:49:01 user nova-compute[74870]:   <name>instance-0000001a</name>
Nov 28 06:49:01 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:49:01 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:49:01 user nova-compute[74870]:   <metadata>
Nov 28 06:49:01 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:49:01 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:49:01 user nova-compute[74870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1621425112</nova:name>
Nov 28 06:49:01 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:49:01</nova:creationTime>
Nov 28 06:49:01 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:49:01 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:49:01 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:49:01 user nova-compute[74870]:       <nova:owner>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:user uuid="109001cce8ec4aa0b87f271b415cd5e6">tempest-ServerRescueNegativeTestJSON-226827849-project-member</nova:user>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:project uuid="8f90603ba77644568ec6f6fd37689a08">tempest-ServerRescueNegativeTestJSON-226827849</nova:project>
Nov 28 06:49:01 user nova-compute[74870]:       </nova:owner>
Nov 28 06:49:01 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:49:01 user nova-compute[74870]:       <nova:ports>
Nov 28 06:49:01 user nova-compute[74870]:         <nova:port uuid="05ecf301-f2f8-4953-997c-6855e4f27db7">
Nov 28 06:49:01 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 06:49:01 user nova-compute[74870]:         </nova:port>
Nov 28 06:49:01 user nova-compute[74870]:       </nova:ports>
Nov 28 06:49:01 user nova-compute[74870]:     </nova:instance>
Nov 28 06:49:01 user nova-compute[74870]:   </metadata>
Nov 28 06:49:01 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:49:01 user nova-compute[74870]:     <system>
Nov 28 06:49:01 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:49:01 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:49:01 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:49:01 user nova-compute[74870]:       <entry name="serial">de112cbb-849e-43c1-961a-4457585f2e9a</entry>
Nov 28 06:49:01 user nova-compute[74870]:       <entry name="uuid">de112cbb-849e-43c1-961a-4457585f2e9a</entry>
Nov 28 06:49:01 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:49:01 user nova-compute[74870]:     </system>
Nov 28 06:49:01 user nova-compute[74870]:   </sysinfo>
Nov 28 06:49:01 user nova-compute[74870]:   <os>
Nov 28 06:49:01 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:49:01 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:49:01 user nova-compute[74870]:   </os>
Nov 28 06:49:01 user nova-compute[74870]:   <features>
Nov 28 06:49:01 user nova-compute[74870]:     <acpi/>
Nov 28 06:49:01 user nova-compute[74870]:     <apic/>
Nov 28 06:49:01 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:49:01 user nova-compute[74870]:   </features>
Nov 28 06:49:01 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:49:01 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:49:01 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:49:01 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:49:01 user nova-compute[74870]:   </clock>
Nov 28 06:49:01 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:49:01 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:49:01 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:49:01 user nova-compute[74870]:   </cpu>
Nov 28 06:49:01 user nova-compute[74870]:   <devices>
Nov 28 06:49:01 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:49:01 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:49:01 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue"/>
Nov 28 06:49:01 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:49:01 user nova-compute[74870]:     </disk>
Nov 28 06:49:01 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:49:01 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:49:01 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk"/>
Nov 28 06:49:01 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:49:01 user nova-compute[74870]:     </disk>
Nov 28 06:49:01 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:49:01 user nova-compute[74870]:       <mac address="fa:16:3e:e7:56:7b"/>
Nov 28 06:49:01 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:49:01 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:49:01 user nova-compute[74870]:       <target dev="tap05ecf301-f2"/>
Nov 28 06:49:01 user nova-compute[74870]:     </interface>
Nov 28 06:49:01 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:49:01 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/console.log" append="off"/>
Nov 28 06:49:01 user nova-compute[74870]:     </serial>
Nov 28 06:49:01 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:49:01 user nova-compute[74870]:     <video>
Nov 28 06:49:01 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:49:01 user nova-compute[74870]:     </video>
Nov 28 06:49:01 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:49:01 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:49:01 user nova-compute[74870]:     </rng>
Nov 28 06:49:01 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:49:01 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:49:01 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:49:01 user nova-compute[74870]:     </memballoon>
Nov 28 06:49:01 user nova-compute[74870]:   </devices>
Nov 28 06:49:01 user nova-compute[74870]: </domain>
Nov 28 06:49:01 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:49:01 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance destroyed successfully.
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:49:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] No VIF found with MAC fa:16:3e:e7:56:7b, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.compute.manager [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:03 user nova-compute[74870]: WARNING nova.compute.manager [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state active and task_state rebuild_spawning.
Nov 28 06:49:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:49:03 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Instance spawned successfully.
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:04 user nova-compute[74870]: WARNING nova.compute.manager [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state rescuing.
Nov 28 06:49:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:04 user nova-compute[74870]: INFO nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Took 10.43 seconds to spawn the instance on the hypervisor.
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:04 user nova-compute[74870]: INFO nova.compute.manager [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Took 11.59 seconds to build instance.
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.745s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:49:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance spawned successfully.
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74870) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 06:49:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:06 user nova-compute[74870]: WARNING nova.compute.manager [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state rescuing.
Nov 28 06:49:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:49:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-changed-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Refreshing instance network info cache due to event network-changed-e51be746-1419-4a95-8bc6-bcf4ed942927. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:49:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Acquiring lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Acquired lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:09 user nova-compute[74870]: DEBUG nova.network.neutron [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Refreshing network info cache for port e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updated VIF entry in instance network info cache for port e51be746-1419-4a95-8bc6-bcf4ed942927. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Releasing lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "interface-75046337-1afd-4458-a305-9922679ce7e3-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "interface-75046337-1afd-4458-a305-9922679ce7e3-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.004s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'flavor' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'pci_requests' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.objects.base [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Object Instance<75046337-1afd-4458-a305-9922679ce7e3> lazy-loaded attributes: flavor,pci_requests {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:49:10 user nova-compute[74870]: DEBUG nova.policy [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:49:11 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Successfully created port: f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Successfully updated port: f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquired lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-changed-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Refreshing instance network info cache due to event network-changed-f6b43f71-0053-4685-829d-52a0eda846b6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Acquiring lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Releasing lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Acquired lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.neutron [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Refreshing network info cache for port f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG os_vif [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '123454aa-f45a-5a4d-8b29-6e0d05d6ef6f', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6b43f71-00, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6b43f71-00, col_values=(('qos', UUID('51c0fc3a-bb63-44fb-867b-105faf89e3af')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6b43f71-00, col_values=(('external_ids', {'iface-id': 'f6b43f71-0053-4685-829d-52a0eda846b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b8:09', 'vm-uuid': '75046337-1afd-4458-a305-9922679ce7e3'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: INFO os_vif [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00')
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] attach device xml: <interface type="ethernet">
Nov 28 06:49:13 user nova-compute[74870]:   <mac address="fa:16:3e:06:b8:09"/>
Nov 28 06:49:13 user nova-compute[74870]:   <model type="virtio"/>
Nov 28 06:49:13 user nova-compute[74870]:   <mtu size="1442"/>
Nov 28 06:49:13 user nova-compute[74870]:   <target dev="tapf6b43f71-00"/>
Nov 28 06:49:13 user nova-compute[74870]: </interface>
Nov 28 06:49:13 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:13 user nova-compute[74870]: WARNING nova.compute.manager [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 for instance with vm_state active and task_state None.
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.neutron [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updated VIF entry in instance network info cache for port f6b43f71-0053-4685-829d-52a0eda846b6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.network.neutron [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Releasing lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No BDM found with device name hda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No VIF found with MAC fa:16:3e:5a:8e:ad, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:49:13 user nova-compute[74870]:   <nova:package version="0.0.0"/>
Nov 28 06:49:13 user nova-compute[74870]:   <nova:name>tempest-device-tagging-server-1048812053</nova:name>
Nov 28 06:49:13 user nova-compute[74870]:   <nova:creationTime>2023-11-28 06:49:13</nova:creationTime>
Nov 28 06:49:13 user nova-compute[74870]:   <nova:flavor name="m1.tiny">
Nov 28 06:49:13 user nova-compute[74870]:     <nova:memory>512</nova:memory>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:disk>1</nova:disk>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:swap>0</nova:swap>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:vcpus>1</nova:vcpus>
Nov 28 06:49:13 user nova-compute[74870]:   </nova:flavor>
Nov 28 06:49:13 user nova-compute[74870]:   <nova:owner>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:user uuid="dde6b091a2134b83806602165f723ade">tempest-TaggedAttachmentsTest-2015143516-project-member</nova:user>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:project uuid="898c9652da6145af82836b639c44458d">tempest-TaggedAttachmentsTest-2015143516</nova:project>
Nov 28 06:49:13 user nova-compute[74870]:   </nova:owner>
Nov 28 06:49:13 user nova-compute[74870]:   <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:49:13 user nova-compute[74870]:   <nova:ports>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:port uuid="e51be746-1419-4a95-8bc6-bcf4ed942927">
Nov 28 06:49:13 user nova-compute[74870]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 06:49:13 user nova-compute[74870]:     </nova:port>
Nov 28 06:49:13 user nova-compute[74870]:     <nova:port uuid="f6b43f71-0053-4685-829d-52a0eda846b6">
Nov 28 06:49:13 user nova-compute[74870]:       <nova:ip type="fixed" address="10.10.10.58" ipVersion="4"/>
Nov 28 06:49:13 user nova-compute[74870]:     </nova:port>
Nov 28 06:49:13 user nova-compute[74870]:   </nova:ports>
Nov 28 06:49:13 user nova-compute[74870]: </nova:instance>
Nov 28 06:49:13 user nova-compute[74870]:  {{(pid=74870) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "interface-75046337-1afd-4458-a305-9922679ce7e3-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.226s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'flavor' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:14 user nova-compute[74870]: INFO nova.compute.manager [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Attaching volume ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b to /dev/vdb
Nov 28 06:49:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c245f4-8466-48a0-a6fe-664bc61026db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b87b1-72e4-417e-8a68-27ab7fdbea84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e083e-1aab-4a9b-8a31-0e22e5787974]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af820b9-ecfc-4d62-b9c8-46b70fb3d748]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:49:14 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:49:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc57536e-ea64-483d-bcd3-29bdddbd9558]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:49:14 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating existing volume attachment record: 2411cea3-b5c5-4d02-9b23-8acecc9f541d {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:15 user nova-compute[74870]: WARNING nova.compute.manager [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 for instance with vm_state active and task_state None.
Nov 28 06:49:17 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:19 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 06:49:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:20 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoDKcqEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:49:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:49:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:49:23 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338b2fe-30b5-4bfa-a59d-7b01a2b16dcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:49:23 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf6daa-60d5-442a-9006-b0d6c3ea913a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b] added
Nov 28 06:49:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c07f4-77e6-41ed-8024-328f7d28ebb2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ec5d92-756c-46a1-8e30-c84abc113e7a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QoDKcqEt {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QoDKcqEt" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af20ae-ef0c-4bde-ba50-4e9f28707a6c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QoDKcqEt'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a21862-8d53-4992-a06b-84c1999d4c34]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eec830b-2022-48db-bee1-07faadb23f1f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c891a3e3-79c9-4e0d-92ee-fdfe5d553398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260]
Nov 28 06:49:23 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260] successful.
Nov 28 06:49:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7d2dde-fe4b-4b03-b59b-bd1ae14935cb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f6edf-6920-4c69-9ecc-908cd8f4f13c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:23 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] HCTL ('40', '-', '-', 0) found on session 32 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14c0066-7782-41a3-9386-3def68a3d122]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Searching for a device in session 32 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoDKcqEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.545s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] <== connect_volume: return (1550ms) {'type': 'block', 'scsi_wwn': '26464303464646438', 'path': '/dev/sdi'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464303464646438', 'path': '/dev/sdi'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'flavor' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:49:24 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:49:24 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:49:24 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:49:24 user nova-compute[74870]:   <serial>ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b</serial>
Nov 28 06:49:24 user nova-compute[74870]: </disk>
Nov 28 06:49:24 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:49:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:49:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7081MB free_disk=25.193099975585938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No BDM found with device name hda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] No VIF found with MAC fa:16:3e:5a:8e:ad, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:49:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.443s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 75046337-1afd-4458-a305-9922679ce7e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance c7a2db07-1739-4fa5-b444-86d602ca586f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance ab422771-7c11-4074-b4a6-d793c790e813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.981s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 06:49:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:27 user nova-compute[74870]: INFO nova.compute.manager [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Detaching volume ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b
Nov 28 06:49:27 user nova-compute[74870]: INFO nova.virt.block_device [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Attempting to driver detach volume ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b from mountpoint /dev/vdb
Nov 28 06:49:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Attempting to detach device vdb from instance 75046337-1afd-4458-a305-9922679ce7e3 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:49:27 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:49:27 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:49:27 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:49:27 user nova-compute[74870]:   <serial>ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b</serial>
Nov 28 06:49:27 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 06:49:27 user nova-compute[74870]: </disk>
Nov 28 06:49:27 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:49:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully detached device vdb from instance 75046337-1afd-4458-a305-9922679ce7e3 from the persistent domain config.
Nov 28 06:49:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75046337-1afd-4458-a305-9922679ce7e3 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:49:27 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:49:27 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:49:27 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:49:27 user nova-compute[74870]:   <serial>ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b</serial>
Nov 28 06:49:27 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 06:49:27 user nova-compute[74870]: </disk>
Nov 28 06:49:27 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updating instance_info_cache with network_info: [{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:49:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:49:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquired lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:49:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'info_cache' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Releasing lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:34 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance destroyed successfully.
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'resources' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20c570c-28, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e10f38f0-1953-47e1-8561-0952ec25d310) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:34 user nova-compute[74870]: INFO os_vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28')
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:49:34 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc9c458-4ac4-4f2f-8dc5-f3ae03a5efe7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:49:34 user nova-compute[74870]: No targets found.
Nov 28 06:49:34 user nova-compute[74870]: iSNS:
Nov 28 06:49:34 user nova-compute[74870]: No targets found.
Nov 28 06:49:34 user nova-compute[74870]: STATIC:
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:49:34 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:34 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:34 user nova-compute[74870]: FIRMWARE:
Nov 28 06:49:34 user nova-compute[74870]: No targets found.
Nov 28 06:49:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:49:34 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:49:34 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c39e6d-97aa-4a78-b347-b04382872bbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b4f0b-0a19-4ab0-8a6c-720ff134a139]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:34 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc6063b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[463e1201-d2c6-4747-923b-674e85ab8613]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2ef0d-9e18-407f-a328-05a9b47a5697]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb97d0-0689-495e-b1f6-4caa789505db]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd90baf-639f-4ce9-844c-570cc77f5429]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b310a44c-0116-4ac9-9733-3588e19c3631]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e5fbff-ed68-4052-b176-74a672d2c183]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]
Nov 28 06:49:34 user nova-compute[74870]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.
Nov 28 06:49:34 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f7061-f494-45bf-b610-08dec73df802]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== disconnect_volume: return (343ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start _get_guest_xml network_info=[{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d', 'attached_at': '', 'detached_at': '', 'volume_id': '142a655f-e1de-4c08-b7e5-e81e50cf760f', 'serial': '142a655f-e1de-4c08-b7e5-e81e50cf760f'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '81ae0592-be58-4f89-9e90-bfce31d56fce', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'numa_topology' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:34 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:49:34 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:49:34 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:49:34 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:49:34 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:49:34 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:49:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae0ae77-effb-45a6-83ed-f98d6ca6b410]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:49:35 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c3125-5ce9-4818-95ac-779e78c64732]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f] added
Nov 28 06:49:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ac3a0-dce8-4ab7-af8f-975c5fe766fe]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10412e6d-7b44-4c47-a79f-d4cf19aff5c5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UumbSJsz {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UumbSJsz" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a683b-f156-40ae-b39f-909b1a5d15fd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UumbSJsz'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e658350-7bc5-4ffc-8ce1-0b369f3e5954]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19652771-80aa-4413-93e8-4b89aee132fe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f2ff9-ec5f-4b0a-a077-d72f3b8d1c2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]
Nov 28 06:49:35 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.
Nov 28 06:49:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f56b56-b30e-428a-bd1e-e0cf01b2fcc3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e23a1aa-219b-4812-a067-063b7ce5fe56]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:35 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:35 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4df793-4f42-45af-81c8-c27aa44f5e38]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:49:35 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23030623065313361', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030623065313361', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:49:36 user nova-compute[74870]:   <uuid>bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</uuid>
Nov 28 06:49:36 user nova-compute[74870]:   <name>instance-00000018</name>
Nov 28 06:49:36 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:49:36 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:49:36 user nova-compute[74870]:   <metadata>
Nov 28 06:49:36 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:49:36 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:49:36 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeTestJSON-server-1513439293</nova:name>
Nov 28 06:49:36 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:49:34</nova:creationTime>
Nov 28 06:49:36 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:49:36 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:49:36 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:49:36 user nova-compute[74870]:       <nova:owner>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:user uuid="63fdd08d34954e97ae65ec1ce1c3d0f6">tempest-AttachVolumeTestJSON-25504685-project-member</nova:user>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:project uuid="2a4f8529212249d68a54698cffcdc44b">tempest-AttachVolumeTestJSON-25504685</nova:project>
Nov 28 06:49:36 user nova-compute[74870]:       </nova:owner>
Nov 28 06:49:36 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:49:36 user nova-compute[74870]:       <nova:ports>
Nov 28 06:49:36 user nova-compute[74870]:         <nova:port uuid="d20c570c-280d-472a-a11a-3e13c3920461">
Nov 28 06:49:36 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:49:36 user nova-compute[74870]:         </nova:port>
Nov 28 06:49:36 user nova-compute[74870]:       </nova:ports>
Nov 28 06:49:36 user nova-compute[74870]:     </nova:instance>
Nov 28 06:49:36 user nova-compute[74870]:   </metadata>
Nov 28 06:49:36 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:49:36 user nova-compute[74870]:     <system>
Nov 28 06:49:36 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:49:36 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:49:36 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:49:36 user nova-compute[74870]:       <entry name="serial">bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</entry>
Nov 28 06:49:36 user nova-compute[74870]:       <entry name="uuid">bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</entry>
Nov 28 06:49:36 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:49:36 user nova-compute[74870]:     </system>
Nov 28 06:49:36 user nova-compute[74870]:   </sysinfo>
Nov 28 06:49:36 user nova-compute[74870]:   <os>
Nov 28 06:49:36 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:49:36 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:49:36 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:49:36 user nova-compute[74870]:   </os>
Nov 28 06:49:36 user nova-compute[74870]:   <features>
Nov 28 06:49:36 user nova-compute[74870]:     <acpi/>
Nov 28 06:49:36 user nova-compute[74870]:     <apic/>
Nov 28 06:49:36 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:49:36 user nova-compute[74870]:   </features>
Nov 28 06:49:36 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:49:36 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:49:36 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:49:36 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:49:36 user nova-compute[74870]:   </clock>
Nov 28 06:49:36 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:49:36 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:49:36 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:49:36 user nova-compute[74870]:   </cpu>
Nov 28 06:49:36 user nova-compute[74870]:   <devices>
Nov 28 06:49:36 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:49:36 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:49:36 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk"/>
Nov 28 06:49:36 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:49:36 user nova-compute[74870]:     </disk>
Nov 28 06:49:36 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:49:36 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:49:36 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 06:49:36 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:49:36 user nova-compute[74870]:       <serial>142a655f-e1de-4c08-b7e5-e81e50cf760f</serial>
Nov 28 06:49:36 user nova-compute[74870]:     </disk>
Nov 28 06:49:36 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:49:36 user nova-compute[74870]:       <mac address="fa:16:3e:88:f4:5c"/>
Nov 28 06:49:36 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:49:36 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:49:36 user nova-compute[74870]:       <target dev="tapd20c570c-28"/>
Nov 28 06:49:36 user nova-compute[74870]:     </interface>
Nov 28 06:49:36 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:49:36 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/console.log" append="off"/>
Nov 28 06:49:36 user nova-compute[74870]:     </serial>
Nov 28 06:49:36 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:49:36 user nova-compute[74870]:     <video>
Nov 28 06:49:36 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:49:36 user nova-compute[74870]:     </video>
Nov 28 06:49:36 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:49:36 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:49:36 user nova-compute[74870]:     </rng>
Nov 28 06:49:36 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:49:36 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:49:36 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:49:36 user nova-compute[74870]:     </memballoon>
Nov 28 06:49:36 user nova-compute[74870]:   </devices>
Nov 28 06:49:36 user nova-compute[74870]: </domain>
Nov 28 06:49:36 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:49:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'migration_context' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG nova.objects.base [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG os_vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb7f9cc8-f611-5d81-a1db-5424875809b0', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20c570c-28, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd20c570c-28, col_values=(('qos', UUID('47738c2f-b403-49e9-a1f5-858c9db55597')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd20c570c-28, col_values=(('external_ids', {'iface-id': 'd20c570c-280d-472a-a11a-3e13c3920461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:f4:5c', 'vm-uuid': 'bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:49:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:37 user nova-compute[74870]: INFO os_vif [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28')
Nov 28 06:49:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:38 user nova-compute[74870]: WARNING nova.compute.manager [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state stopped and task_state powering-on.
Nov 28 06:49:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:40 user nova-compute[74870]: WARNING nova.compute.manager [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state stopped and task_state powering-on.
Nov 28 06:49:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:49:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance rebooted successfully.
Nov 28 06:49:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:49:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75046337-1afd-4458-a305-9922679ce7e3 is timed out.
Nov 28 06:49:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully detached device vdb from instance 75046337-1afd-4458-a305-9922679ce7e3 from the live domain config.
Nov 28 06:49:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoDKcqEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:49:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a89b56-b60f-441f-99a5-f2ff34e70d23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:49:48 user nova-compute[74870]: No targets found.
Nov 28 06:49:48 user nova-compute[74870]: iSNS:
Nov 28 06:49:48 user nova-compute[74870]: No targets found.
Nov 28 06:49:48 user nova-compute[74870]: STATIC:
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:49:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:49:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:49:48 user nova-compute[74870]: FIRMWARE:
Nov 28 06:49:48 user nova-compute[74870]: No targets found.
Nov 28 06:49:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:49:48 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:49:48 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc35d96d-fcf3-4464-ac2a-9165c63e02ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[892c4b3d-938a-4473-b582-5b64abb239d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b (non-flash)
Nov 28 06:49:48 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:49:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc2d9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b'): ({'sdi'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Removing single pathed devices sdi {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d6f88-378b-4f24-85de-d31c985c48ff]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991f8ca-b4a3-47ee-8865-9eba21b46d5e]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Flushing IO for device /dev/sdi {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0945848e-992e-44e6-bf5e-e1b73b866181]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ced880-777e-4a0c-becf-99cb93e0ac2a]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] SCSI volumes sdi have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af4674-b917-4605-ad09-035acd476667]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad031e-5dbe-4bd9-aadb-fc3f77d0e406]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260]
Nov 28 06:49:48 user nova-compute[74870]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b, portal: 172.16.0.220,3260] successful.
Nov 28 06:49:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c42d5fb-c5a2-42c4-bdf4-cefd995a97c8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] <== disconnect_volume: return (358ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:49:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:49:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'flavor' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "interface-75046337-1afd-4458-a305-9922679ce7e3-f6b43f71-0053-4685-829d-52a0eda846b6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "interface-75046337-1afd-4458-a305-9922679ce7e3-f6b43f71-0053-4685-829d-52a0eda846b6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.objects.instance [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'flavor' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:06:b8:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf6b43f71-00"/></interface> {{(pid=74870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:06:b8:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf6b43f71-00"/></interface> {{(pid=74870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Attempting to detach device tapf6b43f71-00 from instance 75046337-1afd-4458-a305-9922679ce7e3 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] detach device xml: <interface type="ethernet">
Nov 28 06:49:50 user nova-compute[74870]:   <mac address="fa:16:3e:06:b8:09"/>
Nov 28 06:49:50 user nova-compute[74870]:   <model type="virtio"/>
Nov 28 06:49:50 user nova-compute[74870]:   <mtu size="1442"/>
Nov 28 06:49:50 user nova-compute[74870]:   <target dev="tapf6b43f71-00"/>
Nov 28 06:49:50 user nova-compute[74870]: </interface>
Nov 28 06:49:50 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:06:b8:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf6b43f71-00"/></interface> {{(pid=74870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:06:b8:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf6b43f71-00"/></interface>not found in domain: <domain type='kvm' id='38'>
Nov 28 06:49:50 user nova-compute[74870]:   <name>instance-0000001c</name>
Nov 28 06:49:50 user nova-compute[74870]:   <uuid>75046337-1afd-4458-a305-9922679ce7e3</uuid>
Nov 28 06:49:50 user nova-compute[74870]:   <metadata>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:49:50 user nova-compute[74870]:   <nova:package version="0.0.0"/>
Nov 28 06:49:50 user nova-compute[74870]:   <nova:name>tempest-device-tagging-server-1048812053</nova:name>
Nov 28 06:49:50 user nova-compute[74870]:   <nova:creationTime>2023-11-28 06:49:13</nova:creationTime>
Nov 28 06:49:50 user nova-compute[74870]:   <nova:flavor name="m1.tiny">
Nov 28 06:49:50 user nova-compute[74870]:     <nova:memory>512</nova:memory>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:disk>1</nova:disk>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:swap>0</nova:swap>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:vcpus>1</nova:vcpus>
Nov 28 06:49:50 user nova-compute[74870]:   </nova:flavor>
Nov 28 06:49:50 user nova-compute[74870]:   <nova:owner>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:user uuid="dde6b091a2134b83806602165f723ade">tempest-TaggedAttachmentsTest-2015143516-project-member</nova:user>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:project uuid="898c9652da6145af82836b639c44458d">tempest-TaggedAttachmentsTest-2015143516</nova:project>
Nov 28 06:49:50 user nova-compute[74870]:   </nova:owner>
Nov 28 06:49:50 user nova-compute[74870]:   <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:49:50 user nova-compute[74870]:   <nova:ports>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:port uuid="e51be746-1419-4a95-8bc6-bcf4ed942927">
Nov 28 06:49:50 user nova-compute[74870]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 06:49:50 user nova-compute[74870]:     </nova:port>
Nov 28 06:49:50 user nova-compute[74870]:     <nova:port uuid="f6b43f71-0053-4685-829d-52a0eda846b6">
Nov 28 06:49:50 user nova-compute[74870]:       <nova:ip type="fixed" address="10.10.10.58" ipVersion="4"/>
Nov 28 06:49:50 user nova-compute[74870]:     </nova:port>
Nov 28 06:49:50 user nova-compute[74870]:   </nova:ports>
Nov 28 06:49:50 user nova-compute[74870]: </nova:instance>
Nov 28 06:49:50 user nova-compute[74870]:   </metadata>
Nov 28 06:49:50 user nova-compute[74870]:   <memory unit='KiB'>524288</memory>
Nov 28 06:49:50 user nova-compute[74870]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 06:49:50 user nova-compute[74870]:   <vcpu placement='static'>1</vcpu>
Nov 28 06:49:50 user nova-compute[74870]:   <resource>
Nov 28 06:49:50 user nova-compute[74870]:     <partition>/machine</partition>
Nov 28 06:49:50 user nova-compute[74870]:   </resource>
Nov 28 06:49:50 user nova-compute[74870]:   <sysinfo type='smbios'>
Nov 28 06:49:50 user nova-compute[74870]:     <system>
Nov 28 06:49:50 user nova-compute[74870]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 06:49:50 user nova-compute[74870]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 06:49:50 user nova-compute[74870]:       <entry name='version'>0.0.0</entry>
Nov 28 06:49:50 user nova-compute[74870]:       <entry name='serial'>75046337-1afd-4458-a305-9922679ce7e3</entry>
Nov 28 06:49:50 user nova-compute[74870]:       <entry name='uuid'>75046337-1afd-4458-a305-9922679ce7e3</entry>
Nov 28 06:49:50 user nova-compute[74870]:       <entry name='family'>Virtual Machine</entry>
Nov 28 06:49:50 user nova-compute[74870]:     </system>
Nov 28 06:49:50 user nova-compute[74870]:   </sysinfo>
Nov 28 06:49:50 user nova-compute[74870]:   <os>
Nov 28 06:49:50 user nova-compute[74870]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 06:49:50 user nova-compute[74870]:     <boot dev='hd'/>
Nov 28 06:49:50 user nova-compute[74870]:     <smbios mode='sysinfo'/>
Nov 28 06:49:50 user nova-compute[74870]:   </os>
Nov 28 06:49:50 user nova-compute[74870]:   <features>
Nov 28 06:49:50 user nova-compute[74870]:     <acpi/>
Nov 28 06:49:50 user nova-compute[74870]:     <apic/>
Nov 28 06:49:50 user nova-compute[74870]:     <vmcoreinfo state='on'/>
Nov 28 06:49:50 user nova-compute[74870]:   </features>
Nov 28 06:49:50 user nova-compute[74870]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 06:49:50 user nova-compute[74870]:     <model fallback='forbid'>Nehalem</model>
Nov 28 06:49:50 user nova-compute[74870]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 06:49:50 user nova-compute[74870]:     <feature policy='require' name='vme'/>
Nov 28 06:49:50 user nova-compute[74870]:     <feature policy='require' name='x2apic'/>
Nov 28 06:49:50 user nova-compute[74870]:     <feature policy='require' name='hypervisor'/>
Nov 28 06:49:50 user nova-compute[74870]:   </cpu>
Nov 28 06:49:50 user nova-compute[74870]:   <clock offset='utc'>
Nov 28 06:49:50 user nova-compute[74870]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 06:49:50 user nova-compute[74870]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 06:49:50 user nova-compute[74870]:     <timer name='hpet' present='no'/>
Nov 28 06:49:50 user nova-compute[74870]:   </clock>
Nov 28 06:49:50 user nova-compute[74870]:   <on_poweroff>destroy</on_poweroff>
Nov 28 06:49:50 user nova-compute[74870]:   <on_reboot>restart</on_reboot>
Nov 28 06:49:50 user nova-compute[74870]:   <on_crash>destroy</on_crash>
Nov 28 06:49:50 user nova-compute[74870]:   <devices>
Nov 28 06:49:50 user nova-compute[74870]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 06:49:50 user nova-compute[74870]:     <disk type='file' device='disk'>
Nov 28 06:49:50 user nova-compute[74870]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 06:49:50 user nova-compute[74870]:       <source file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk' index='2'/>
Nov 28 06:49:50 user nova-compute[74870]:       <backingStore type='file' index='3'>
Nov 28 06:49:50 user nova-compute[74870]:         <format type='raw'/>
Nov 28 06:49:50 user nova-compute[74870]:         <source file='/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c'/>
Nov 28 06:49:50 user nova-compute[74870]:         <backingStore/>
Nov 28 06:49:50 user nova-compute[74870]:       </backingStore>
Nov 28 06:49:50 user nova-compute[74870]:       <target dev='vda' bus='virtio'/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='virtio-disk0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </disk>
Nov 28 06:49:50 user nova-compute[74870]:     <disk type='file' device='cdrom'>
Nov 28 06:49:50 user nova-compute[74870]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 06:49:50 user nova-compute[74870]:       <source file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.config' index='1'/>
Nov 28 06:49:50 user nova-compute[74870]:       <backingStore/>
Nov 28 06:49:50 user nova-compute[74870]:       <target dev='hda' bus='ide'/>
Nov 28 06:49:50 user nova-compute[74870]:       <readonly/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='ide0-0-0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </disk>
Nov 28 06:49:50 user nova-compute[74870]:     <controller type='usb' index='0' model='none'>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='usb'/>
Nov 28 06:49:50 user nova-compute[74870]:     </controller>
Nov 28 06:49:50 user nova-compute[74870]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='pci.0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </controller>
Nov 28 06:49:50 user nova-compute[74870]:     <controller type='ide' index='0'>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='ide'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 06:49:50 user nova-compute[74870]:     </controller>
Nov 28 06:49:50 user nova-compute[74870]:     <interface type='ethernet'>
Nov 28 06:49:50 user nova-compute[74870]:       <mac address='fa:16:3e:5a:8e:ad'/>
Nov 28 06:49:50 user nova-compute[74870]:       <target dev='tape51be746-14'/>
Nov 28 06:49:50 user nova-compute[74870]:       <model type='virtio'/>
Nov 28 06:49:50 user nova-compute[74870]:       <mtu size='1442'/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='net0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </interface>
Nov 28 06:49:50 user nova-compute[74870]:     <interface type='ethernet'>
Nov 28 06:49:50 user nova-compute[74870]:       <mac address='fa:16:3e:06:b8:09'/>
Nov 28 06:49:50 user nova-compute[74870]:       <target dev='tapf6b43f71-00'/>
Nov 28 06:49:50 user nova-compute[74870]:       <model type='virtio'/>
Nov 28 06:49:50 user nova-compute[74870]:       <mtu size='1442'/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='net1'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </interface>
Nov 28 06:49:50 user nova-compute[74870]:     <serial type='pty'>
Nov 28 06:49:50 user nova-compute[74870]:       <source path='/dev/pts/3'/>
Nov 28 06:49:50 user nova-compute[74870]:       <log file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/console.log' append='off'/>
Nov 28 06:49:50 user nova-compute[74870]:       <target type='isa-serial' port='0'>
Nov 28 06:49:50 user nova-compute[74870]:         <model name='isa-serial'/>
Nov 28 06:49:50 user nova-compute[74870]:       </target>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='serial0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </serial>
Nov 28 06:49:50 user nova-compute[74870]:     <console type='pty' tty='/dev/pts/3'>
Nov 28 06:49:50 user nova-compute[74870]:       <source path='/dev/pts/3'/>
Nov 28 06:49:50 user nova-compute[74870]:       <log file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/console.log' append='off'/>
Nov 28 06:49:50 user nova-compute[74870]:       <target type='serial' port='0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='serial0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </console>
Nov 28 06:49:50 user nova-compute[74870]:     <input type='mouse' bus='ps2'>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='input0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </input>
Nov 28 06:49:50 user nova-compute[74870]:     <input type='keyboard' bus='ps2'>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='input1'/>
Nov 28 06:49:50 user nova-compute[74870]:     </input>
Nov 28 06:49:50 user nova-compute[74870]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 28 06:49:50 user nova-compute[74870]:       <listen type='address' address='0.0.0.0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </graphics>
Nov 28 06:49:50 user nova-compute[74870]:     <audio id='1' type='none'/>
Nov 28 06:49:50 user nova-compute[74870]:     <video>
Nov 28 06:49:50 user nova-compute[74870]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='video0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </video>
Nov 28 06:49:50 user nova-compute[74870]:     <memballoon model='virtio'>
Nov 28 06:49:50 user nova-compute[74870]:       <stats period='10'/>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='balloon0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </memballoon>
Nov 28 06:49:50 user nova-compute[74870]:     <rng model='virtio'>
Nov 28 06:49:50 user nova-compute[74870]:       <backend model='random'>/dev/urandom</backend>
Nov 28 06:49:50 user nova-compute[74870]:       <alias name='rng0'/>
Nov 28 06:49:50 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 06:49:50 user nova-compute[74870]:     </rng>
Nov 28 06:49:50 user nova-compute[74870]:   </devices>
Nov 28 06:49:50 user nova-compute[74870]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 06:49:50 user nova-compute[74870]:     <label>libvirt-75046337-1afd-4458-a305-9922679ce7e3</label>
Nov 28 06:49:50 user nova-compute[74870]:     <imagelabel>libvirt-75046337-1afd-4458-a305-9922679ce7e3</imagelabel>
Nov 28 06:49:50 user nova-compute[74870]:   </seclabel>
Nov 28 06:49:50 user nova-compute[74870]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 06:49:50 user nova-compute[74870]:     <label>+64055:+108</label>
Nov 28 06:49:50 user nova-compute[74870]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 06:49:50 user nova-compute[74870]:   </seclabel>
Nov 28 06:49:50 user nova-compute[74870]: </domain>
Nov 28 06:49:50 user nova-compute[74870]:  {{(pid=74870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 06:49:50 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully detached device tapf6b43f71-00 from instance 75046337-1afd-4458-a305-9922679ce7e3 from the persistent domain config.
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] (1/8): Attempting to detach device tapf6b43f71-00 with device alias net1 from instance 75046337-1afd-4458-a305-9922679ce7e3 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] detach device xml: <interface type="ethernet">
Nov 28 06:49:50 user nova-compute[74870]:   <mac address="fa:16:3e:06:b8:09"/>
Nov 28 06:49:50 user nova-compute[74870]:   <model type="virtio"/>
Nov 28 06:49:50 user nova-compute[74870]:   <mtu size="1442"/>
Nov 28 06:49:50 user nova-compute[74870]:   <target dev="tapf6b43f71-00"/>
Nov 28 06:49:50 user nova-compute[74870]: </interface>
Nov 28 06:49:50 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Start waiting for the detach event from libvirt for device tapf6b43f71-00 with device alias net1 for instance 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-unplugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-unplugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:50 user nova-compute[74870]: WARNING nova.compute.manager [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-unplugged-f6b43f71-0053-4685-829d-52a0eda846b6 for instance with vm_state active and task_state None.
Nov 28 06:49:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:49:52 user nova-compute[74870]: WARNING nova.compute.manager [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-plugged-f6b43f71-0053-4685-829d-52a0eda846b6 for instance with vm_state active and task_state None.
Nov 28 06:49:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:49:54 user nova-compute[74870]: INFO nova.compute.claims [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Claim successful on node user
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:49:54 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:49:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:49:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:49:55 user nova-compute[74870]: DEBUG nova.policy [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:49:55 user nova-compute[74870]: INFO nova.virt.block_device [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Booting with volume-backed-image f62a76e5-f00c-416b-84d0-db9b754396ab at /dev/vda
Nov 28 06:49:55 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Successfully created port: afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:49:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Successfully updated port: afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-changed-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Refreshing instance network info cache due to event network-changed-afd5f93d-f360-467a-9e4c-b7816bcd41ae. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Acquiring lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:49:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating instance_info_cache with network_info: [{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance network_info: |[{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Acquired lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG nova.network.neutron [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Refreshing network info cache for port afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG nova.network.neutron [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updated VIF entry in instance network info cache for port afd5f93d-f360-467a-9e4c-b7816bcd41ae. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG nova.network.neutron [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating instance_info_cache with network_info: [{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:49:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Releasing lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:49:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:49:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG os_brick.utils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2615c-1c36-46ed-83cc-95e4f884dc00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75752c64-9947-490c-bbb0-639c3f4bce2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546deeb-92cd-4560-8463-103f8321d5ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85746b5-e8d7-4600-ab85-027bf475c0fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:01 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:50:01 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b9cd3-ce7d-4098-a081-8a556f23bde8]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG os_brick.utils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== get_connector_properties: return (314ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:01 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating existing volume attachment record: 6274d909-58d3-470d-b540-06cd470c1b0f {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:50:02 user nova-compute[74870]: INFO nova.compute.claims [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Claim successful on node user
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:50:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:50:02 user nova-compute[74870]: DEBUG nova.policy [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:50:03 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Creating image(s)
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "/opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "/opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "/opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.240s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Successfully created port: 632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk 1073741824" returned: 0 in 0.050s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Cannot resize image /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Ensure instance console log exists: /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Successfully updated port: 632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "refresh_cache-f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquired lock "refresh_cache-f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-changed-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Refreshing instance network info cache due to event network-changed-632eb6d0-1687-4fac-a60d-f919d2ea0941. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Acquiring lock "refresh_cache-f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-changed-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing instance network info cache due to event network-changed-ce346bd0-6d5d-45d0-9165-4da3207ce081. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Acquiring lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Acquired lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Refreshing network info cache for port ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Updating instance_info_cache with network_info: [{"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Releasing lock "refresh_cache-f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Instance network_info: |[{"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Acquired lock "refresh_cache-f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Refreshing network info cache for port 632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Start _get_guest_xml network_info=[{"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:50:04 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:50:04 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1539515390',display_name='tempest-VolumesActionsTest-instance-1539515390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1539515390',id=33,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4386d41a22343b185f320b3f90d1a83',ramdisk_id='',reservation_id='r-n45129z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1371009149',owner_user_name='tempest-VolumesActionsTest-1371009149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:50:03Z,user_data=None,user_id='9a2c63a8fe9f4992b7ff2aa75a6c4b86',uuid=f69fbbd9-cf47-4ef8-8a60-848ee895a8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converting VIF {"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lazy-loading 'pci_devices' on Instance uuid f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:50:04 user nova-compute[74870]:   <uuid>f69fbbd9-cf47-4ef8-8a60-848ee895a8e6</uuid>
Nov 28 06:50:04 user nova-compute[74870]:   <name>instance-00000021</name>
Nov 28 06:50:04 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:50:04 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:50:04 user nova-compute[74870]:   <metadata>
Nov 28 06:50:04 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:50:04 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:50:04 user nova-compute[74870]:       <nova:name>tempest-VolumesActionsTest-instance-1539515390</nova:name>
Nov 28 06:50:04 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:50:04</nova:creationTime>
Nov 28 06:50:04 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:50:04 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:50:04 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:50:04 user nova-compute[74870]:       <nova:owner>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:user uuid="9a2c63a8fe9f4992b7ff2aa75a6c4b86">tempest-VolumesActionsTest-1371009149-project-member</nova:user>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:project uuid="d4386d41a22343b185f320b3f90d1a83">tempest-VolumesActionsTest-1371009149</nova:project>
Nov 28 06:50:04 user nova-compute[74870]:       </nova:owner>
Nov 28 06:50:04 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:50:04 user nova-compute[74870]:       <nova:ports>
Nov 28 06:50:04 user nova-compute[74870]:         <nova:port uuid="632eb6d0-1687-4fac-a60d-f919d2ea0941">
Nov 28 06:50:04 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 06:50:04 user nova-compute[74870]:         </nova:port>
Nov 28 06:50:04 user nova-compute[74870]:       </nova:ports>
Nov 28 06:50:04 user nova-compute[74870]:     </nova:instance>
Nov 28 06:50:04 user nova-compute[74870]:   </metadata>
Nov 28 06:50:04 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:50:04 user nova-compute[74870]:     <system>
Nov 28 06:50:04 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:50:04 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:50:04 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:50:04 user nova-compute[74870]:       <entry name="serial">f69fbbd9-cf47-4ef8-8a60-848ee895a8e6</entry>
Nov 28 06:50:04 user nova-compute[74870]:       <entry name="uuid">f69fbbd9-cf47-4ef8-8a60-848ee895a8e6</entry>
Nov 28 06:50:04 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:50:04 user nova-compute[74870]:     </system>
Nov 28 06:50:04 user nova-compute[74870]:   </sysinfo>
Nov 28 06:50:04 user nova-compute[74870]:   <os>
Nov 28 06:50:04 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:50:04 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:50:04 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:50:04 user nova-compute[74870]:   </os>
Nov 28 06:50:04 user nova-compute[74870]:   <features>
Nov 28 06:50:04 user nova-compute[74870]:     <acpi/>
Nov 28 06:50:04 user nova-compute[74870]:     <apic/>
Nov 28 06:50:04 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:50:04 user nova-compute[74870]:   </features>
Nov 28 06:50:04 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:50:04 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:50:04 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:50:04 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:50:04 user nova-compute[74870]:   </clock>
Nov 28 06:50:04 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:50:04 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:50:04 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:50:04 user nova-compute[74870]:   </cpu>
Nov 28 06:50:04 user nova-compute[74870]:   <devices>
Nov 28 06:50:04 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:50:04 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:50:04 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk"/>
Nov 28 06:50:04 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:50:04 user nova-compute[74870]:     </disk>
Nov 28 06:50:04 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:50:04 user nova-compute[74870]:       <mac address="fa:16:3e:bb:f3:5e"/>
Nov 28 06:50:04 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:50:04 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:50:04 user nova-compute[74870]:       <target dev="tap632eb6d0-16"/>
Nov 28 06:50:04 user nova-compute[74870]:     </interface>
Nov 28 06:50:04 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:50:04 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/console.log" append="off"/>
Nov 28 06:50:04 user nova-compute[74870]:     </serial>
Nov 28 06:50:04 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:50:04 user nova-compute[74870]:     <video>
Nov 28 06:50:04 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:50:04 user nova-compute[74870]:     </video>
Nov 28 06:50:04 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:50:04 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:50:04 user nova-compute[74870]:     </rng>
Nov 28 06:50:04 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:50:04 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:50:04 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:50:04 user nova-compute[74870]:     </memballoon>
Nov 28 06:50:04 user nova-compute[74870]:   </devices>
Nov 28 06:50:04 user nova-compute[74870]: </domain>
Nov 28 06:50:04 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1539515390',display_name='tempest-VolumesActionsTest-instance-1539515390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1539515390',id=33,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4386d41a22343b185f320b3f90d1a83',ramdisk_id='',reservation_id='r-n45129z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1371009149',owner_user_name='tempest-VolumesActionsTest-1371009149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:50:03Z,user_data=None,user_id='9a2c63a8fe9f4992b7ff2aa75a6c4b86',uuid=f69fbbd9-cf47-4ef8-8a60-848ee895a8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converting VIF {"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG os_vif [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d792437-0221-5af7-ba9c-07e12b361eab', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap632eb6d0-16, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap632eb6d0-16, col_values=(('qos', UUID('ab181fca-45f0-4964-ab97-d2b81a90773a')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap632eb6d0-16, col_values=(('external_ids', {'iface-id': '632eb6d0-1687-4fac-a60d-f919d2ea0941', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:f3:5e', 'vm-uuid': 'f69fbbd9-cf47-4ef8-8a60-848ee895a8e6'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:04 user nova-compute[74870]: INFO os_vif [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16')
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updated VIF entry in instance network info cache for port ce346bd0-6d5d-45d0-9165-4da3207ce081. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] No VIF found with MAC fa:16:3e:bb:f3:5e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:50:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Releasing lock "refresh_cache-c7a2db07-1739-4fa5-b444-86d602ca586f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:05 user nova-compute[74870]: DEBUG nova.network.neutron [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Updated VIF entry in instance network info cache for port 632eb6d0-1687-4fac-a60d-f919d2ea0941. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:50:05 user nova-compute[74870]: DEBUG nova.network.neutron [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Updating instance_info_cache with network_info: [{"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Releasing lock "refresh_cache-f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] No waiting events found dispatching network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:06 user nova-compute[74870]: WARNING nova.compute.manager [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received unexpected event network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance with vm_state building and task_state spawning.
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:07 user nova-compute[74870]: INFO nova.compute.manager [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Terminating instance
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-0314f996-11e4-4335-8088-c85a9ec88931 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] No waiting events found dispatching network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:08 user nova-compute[74870]: WARNING nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received unexpected event network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance with vm_state building and task_state spawning.
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:08 user nova-compute[74870]: WARNING nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance with vm_state active and task_state deleting.
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:50:08 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Instance spawned successfully.
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:08 user nova-compute[74870]: INFO nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 28 06:50:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:50:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:08 user nova-compute[74870]: INFO nova.compute.manager [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Took 6.67 seconds to build instance.
Nov 28 06:50:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.790s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Instance destroyed successfully.
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lazy-loading 'resources' on Instance uuid c7a2db07-1739-4fa5-b444-86d602ca586f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce346bd0-6d, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d236f9f1-0f43-4942-90e6-18c0000c7b78) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:7a:a8,bridge_name='br-int',has_traffic_filtering=True,id=ce346bd0-6d5d-45d0-9165-4da3207ce081,network=Network(4017cd74-3c8e-48cb-a991-090413120603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce346bd0-6d')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57870541-c5, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bbcf677-60b3-45e6-b773-dd4cc61bfb59) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:76,bridge_name='br-int',has_traffic_filtering=True,id=57870541-c5b7-4cd3-9836-64b4ee4ffb81,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57870541-c5')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a5dfb04-4a, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b9682cc-9178-4948-82a7-8f3fcc0d0dfe) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:31,bridge_name='br-int',has_traffic_filtering=True,id=7a5dfb04-4a6f-4704-9885-d38d223aeae6,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a5dfb04-4a')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0314f996-11, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c647856f-a09a-4bde-9303-025022cbdcca) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:31:1f,bridge_name='br-int',has_traffic_filtering=True,id=0314f996-11e4-4335-8088-c85a9ec88931,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0314f996-11')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "address": "fa:16:3e:cc:f5:d7", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40d74d10-74", "ovs_interfaceid": "40d74d10-744b-4187-8a27-c72bfc4b1a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40d74d10-74, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: WARNING nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance with vm_state active and task_state deleting.
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: WARNING nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance with vm_state active and task_state deleting.
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: WARNING nova.compute.manager [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance with vm_state active and task_state deleting.
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb418681-f699-4c20-b483-a0c4b404fa53) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f5:d7,bridge_name='br-int',has_traffic_filtering=True,id=40d74d10-744b-4187-8a27-c72bfc4b1a47,network=Network(ceec40e5-bc75-4dae-9329-401faa72d72b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40d74d10-74')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ab023f9-1a, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2745e24d-cb51-433a-a3b4-c3e26e7fd7fe) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:37:38,bridge_name='br-int',has_traffic_filtering=True,id=8ab023f9-1a91-43d1-a020-8ecd1a6eafaf,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ab023f9-1a')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1427016084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1427016084',id=29,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ==',key_name='tempest-keypair-651126540',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24232ad48c7c4b6c94efc23f0682247f',ramdisk_id='',reservation_id='r-v0jk92oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-976904504',owner_user_name='tempest-TaggedBootDevicesTest_v242-976904504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59abab1396dc462cab4cd9c945c446f5',uuid=c7a2db07-1739-4fa5-b444-86d602ca586f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converting VIF {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1a310b8-79, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62889545-c867-447c-974b-a403317ea8cc) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:09 user nova-compute[74870]: INFO os_vif [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=c1a310b8-79bf-4098-a7f8-0f1736c5dd79,network=Network(33adf66c-17ae-4bf1-a70e-8f374e75cd95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a310b8-79')
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTFxJKdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:09 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: WARNING nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-0314f996-11e4-4335-8088-c85a9ec88931 for instance with vm_state active and task_state deleting.
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-unplugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-unplugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:09 user nova-compute[74870]: WARNING nova.compute.manager [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance with vm_state active and task_state deleting.
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eed97e-0a36-411e-96cb-dec2ffd40692]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:50:09 user nova-compute[74870]: No targets found.
Nov 28 06:50:09 user nova-compute[74870]: iSNS:
Nov 28 06:50:09 user nova-compute[74870]: No targets found.
Nov 28 06:50:09 user nova-compute[74870]: STATIC:
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:50:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:09 user nova-compute[74870]: FIRMWARE:
Nov 28 06:50:09 user nova-compute[74870]: No targets found.
Nov 28 06:50:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:50:09 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:50:09 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a63f354-b95c-47b5-8f55-f3cd810fdd12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d11998-e65c-4253-b919-ef059c8f66a3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:09 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7f37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd800ba-9039-49c5-9207-effa71c1d0b4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ece84-be3f-47d4-91d0-4e3477623292]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[914998af-c3a4-4be9-bb23-599426259a19]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051c585-1784-48c5-ae71-6e645e2a0f36]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b1aec-a01c-4620-9d3a-b74a5c9fd365]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ce089c-2149-454d-b410-6ad02be69ece]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260]
Nov 28 06:50:10 user nova-compute[74870]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c0c714-f163-4492-af6c-f07ed4e57c74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd3df4-3b92-4dc8-b137-25143378ccc4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== disconnect_volume: return (393ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:50:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Creating image(s)
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Ensure instance console log exists: /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Start _get_guest_xml network_info=[{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a328017-e6a2-4b35-a18d-d51a14e29895', 'attached_at': '', 'detached_at': '', 'volume_id': 'd49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'serial': 'd49686c2-d776-448d-ad9b-8e0fc72e9d2b'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6274d909-58d3-470d-b540-06cd470c1b0f', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEzLqtYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:50:10 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a529f60a-3681-4325-8893-4111a56c6349]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:50:10 user nova-compute[74870]: No targets found.
Nov 28 06:50:10 user nova-compute[74870]: iSNS:
Nov 28 06:50:10 user nova-compute[74870]: No targets found.
Nov 28 06:50:10 user nova-compute[74870]: STATIC:
Nov 28 06:50:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7
Nov 28 06:50:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:50:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:50:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:50:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:50:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:50:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:10 user nova-compute[74870]: FIRMWARE:
Nov 28 06:50:10 user nova-compute[74870]: No targets found.
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:50:10 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:50:10 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62ac4f-f771-43a1-b19d-d5e86d4f42c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b382bd22-9cf9-4846-9717-c14ad648f437]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fceffb53a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7'): ({'sdf'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Removing single pathed devices sdf {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae8fc0-d245-4ad2-b5b2-30ff2fe96bfa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9eac16-2a95-4f87-ac23-15967ad13fa4]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flushing IO for device /dev/sdf {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9893c4-e017-4206-88f2-30171b7d3838]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa38bbaf-49a4-4aee-bf7b-0d8b4b8e5a5e]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11e6d0e-3370-41a5-92d3-6d33caaae572]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Waiting for libvirt event about the detach of device tapf6b43f71-00 with device alias net1 from instance 75046337-1afd-4458-a305-9922679ce7e3 is timed out.
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:06:b8:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf6b43f71-00"/></interface> {{(pid=74870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Acquiring lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] No waiting events found dispatching network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING nova.compute.manager [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received unexpected event network-vif-plugged-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance with vm_state active and task_state deleting.
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:06:b8:09"/><model type="virtio"/><mtu size="1442"/><target dev="tapf6b43f71-00"/></interface>not found in domain: <domain type='kvm' id='38'>
Nov 28 06:50:10 user nova-compute[74870]:   <name>instance-0000001c</name>
Nov 28 06:50:10 user nova-compute[74870]:   <uuid>75046337-1afd-4458-a305-9922679ce7e3</uuid>
Nov 28 06:50:10 user nova-compute[74870]:   <metadata>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:50:10 user nova-compute[74870]:   <nova:package version="0.0.0"/>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:name>tempest-device-tagging-server-1048812053</nova:name>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:creationTime>2023-11-28 06:49:13</nova:creationTime>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:flavor name="m1.tiny">
Nov 28 06:50:10 user nova-compute[74870]:     <nova:memory>512</nova:memory>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:disk>1</nova:disk>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:swap>0</nova:swap>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:vcpus>1</nova:vcpus>
Nov 28 06:50:10 user nova-compute[74870]:   </nova:flavor>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:owner>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:user uuid="dde6b091a2134b83806602165f723ade">tempest-TaggedAttachmentsTest-2015143516-project-member</nova:user>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:project uuid="898c9652da6145af82836b639c44458d">tempest-TaggedAttachmentsTest-2015143516</nova:project>
Nov 28 06:50:10 user nova-compute[74870]:   </nova:owner>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:ports>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:port uuid="e51be746-1419-4a95-8bc6-bcf4ed942927">
Nov 28 06:50:10 user nova-compute[74870]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 06:50:10 user nova-compute[74870]:     </nova:port>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:port uuid="f6b43f71-0053-4685-829d-52a0eda846b6">
Nov 28 06:50:10 user nova-compute[74870]:       <nova:ip type="fixed" address="10.10.10.58" ipVersion="4"/>
Nov 28 06:50:10 user nova-compute[74870]:     </nova:port>
Nov 28 06:50:10 user nova-compute[74870]:   </nova:ports>
Nov 28 06:50:10 user nova-compute[74870]: </nova:instance>
Nov 28 06:50:10 user nova-compute[74870]:   </metadata>
Nov 28 06:50:10 user nova-compute[74870]:   <memory unit='KiB'>524288</memory>
Nov 28 06:50:10 user nova-compute[74870]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 06:50:10 user nova-compute[74870]:   <vcpu placement='static'>1</vcpu>
Nov 28 06:50:10 user nova-compute[74870]:   <resource>
Nov 28 06:50:10 user nova-compute[74870]:     <partition>/machine</partition>
Nov 28 06:50:10 user nova-compute[74870]:   </resource>
Nov 28 06:50:10 user nova-compute[74870]:   <sysinfo type='smbios'>
Nov 28 06:50:10 user nova-compute[74870]:     <system>
Nov 28 06:50:10 user nova-compute[74870]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 06:50:10 user nova-compute[74870]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 06:50:10 user nova-compute[74870]:       <entry name='version'>0.0.0</entry>
Nov 28 06:50:10 user nova-compute[74870]:       <entry name='serial'>75046337-1afd-4458-a305-9922679ce7e3</entry>
Nov 28 06:50:10 user nova-compute[74870]:       <entry name='uuid'>75046337-1afd-4458-a305-9922679ce7e3</entry>
Nov 28 06:50:10 user nova-compute[74870]:       <entry name='family'>Virtual Machine</entry>
Nov 28 06:50:10 user nova-compute[74870]:     </system>
Nov 28 06:50:10 user nova-compute[74870]:   </sysinfo>
Nov 28 06:50:10 user nova-compute[74870]:   <os>
Nov 28 06:50:10 user nova-compute[74870]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 06:50:10 user nova-compute[74870]:     <boot dev='hd'/>
Nov 28 06:50:10 user nova-compute[74870]:     <smbios mode='sysinfo'/>
Nov 28 06:50:10 user nova-compute[74870]:   </os>
Nov 28 06:50:10 user nova-compute[74870]:   <features>
Nov 28 06:50:10 user nova-compute[74870]:     <acpi/>
Nov 28 06:50:10 user nova-compute[74870]:     <apic/>
Nov 28 06:50:10 user nova-compute[74870]:     <vmcoreinfo state='on'/>
Nov 28 06:50:10 user nova-compute[74870]:   </features>
Nov 28 06:50:10 user nova-compute[74870]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 06:50:10 user nova-compute[74870]:     <model fallback='forbid'>Nehalem</model>
Nov 28 06:50:10 user nova-compute[74870]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 06:50:10 user nova-compute[74870]:     <feature policy='require' name='vme'/>
Nov 28 06:50:10 user nova-compute[74870]:     <feature policy='require' name='x2apic'/>
Nov 28 06:50:10 user nova-compute[74870]:     <feature policy='require' name='hypervisor'/>
Nov 28 06:50:10 user nova-compute[74870]:   </cpu>
Nov 28 06:50:10 user nova-compute[74870]:   <clock offset='utc'>
Nov 28 06:50:10 user nova-compute[74870]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 06:50:10 user nova-compute[74870]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 06:50:10 user nova-compute[74870]:     <timer name='hpet' present='no'/>
Nov 28 06:50:10 user nova-compute[74870]:   </clock>
Nov 28 06:50:10 user nova-compute[74870]:   <on_poweroff>destroy</on_poweroff>
Nov 28 06:50:10 user nova-compute[74870]:   <on_reboot>restart</on_reboot>
Nov 28 06:50:10 user nova-compute[74870]:   <on_crash>destroy</on_crash>
Nov 28 06:50:10 user nova-compute[74870]:   <devices>
Nov 28 06:50:10 user nova-compute[74870]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 06:50:10 user nova-compute[74870]:     <disk type='file' device='disk'>
Nov 28 06:50:10 user nova-compute[74870]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 06:50:10 user nova-compute[74870]:       <source file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk' index='2'/>
Nov 28 06:50:10 user nova-compute[74870]:       <backingStore type='file' index='3'>
Nov 28 06:50:10 user nova-compute[74870]:         <format type='raw'/>
Nov 28 06:50:10 user nova-compute[74870]:         <source file='/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c'/>
Nov 28 06:50:10 user nova-compute[74870]:         <backingStore/>
Nov 28 06:50:10 user nova-compute[74870]:       </backingStore>
Nov 28 06:50:10 user nova-compute[74870]:       <target dev='vda' bus='virtio'/>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='virtio-disk0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </disk>
Nov 28 06:50:10 user nova-compute[74870]:     <disk type='file' device='cdrom'>
Nov 28 06:50:10 user nova-compute[74870]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 06:50:10 user nova-compute[74870]:       <source file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk.config' index='1'/>
Nov 28 06:50:10 user nova-compute[74870]:       <backingStore/>
Nov 28 06:50:10 user nova-compute[74870]:       <target dev='hda' bus='ide'/>
Nov 28 06:50:10 user nova-compute[74870]:       <readonly/>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='ide0-0-0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </disk>
Nov 28 06:50:10 user nova-compute[74870]:     <controller type='usb' index='0' model='none'>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='usb'/>
Nov 28 06:50:10 user nova-compute[74870]:     </controller>
Nov 28 06:50:10 user nova-compute[74870]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='pci.0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </controller>
Nov 28 06:50:10 user nova-compute[74870]:     <controller type='ide' index='0'>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='ide'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 06:50:10 user nova-compute[74870]:     </controller>
Nov 28 06:50:10 user nova-compute[74870]:     <interface type='ethernet'>
Nov 28 06:50:10 user nova-compute[74870]:       <mac address='fa:16:3e:5a:8e:ad'/>
Nov 28 06:50:10 user nova-compute[74870]:       <target dev='tape51be746-14'/>
Nov 28 06:50:10 user nova-compute[74870]:       <model type='virtio'/>
Nov 28 06:50:10 user nova-compute[74870]:       <mtu size='1442'/>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='net0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </interface>
Nov 28 06:50:10 user nova-compute[74870]:     <serial type='pty'>
Nov 28 06:50:10 user nova-compute[74870]:       <source path='/dev/pts/3'/>
Nov 28 06:50:10 user nova-compute[74870]:       <log file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/console.log' append='off'/>
Nov 28 06:50:10 user nova-compute[74870]:       <target type='isa-serial' port='0'>
Nov 28 06:50:10 user nova-compute[74870]:         <model name='isa-serial'/>
Nov 28 06:50:10 user nova-compute[74870]:       </target>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='serial0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </serial>
Nov 28 06:50:10 user nova-compute[74870]:     <console type='pty' tty='/dev/pts/3'>
Nov 28 06:50:10 user nova-compute[74870]:       <source path='/dev/pts/3'/>
Nov 28 06:50:10 user nova-compute[74870]:       <log file='/opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/console.log' append='off'/>
Nov 28 06:50:10 user nova-compute[74870]:       <target type='serial' port='0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='serial0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </console>
Nov 28 06:50:10 user nova-compute[74870]:     <input type='mouse' bus='ps2'>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='input0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </input>
Nov 28 06:50:10 user nova-compute[74870]:     <input type='keyboard' bus='ps2'>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='input1'/>
Nov 28 06:50:10 user nova-compute[74870]:     </input>
Nov 28 06:50:10 user nova-compute[74870]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 28 06:50:10 user nova-compute[74870]:       <listen type='address' address='0.0.0.0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </graphics>
Nov 28 06:50:10 user nova-compute[74870]:     <audio id='1' type='none'/>
Nov 28 06:50:10 user nova-compute[74870]:     <video>
Nov 28 06:50:10 user nova-compute[74870]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='video0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </video>
Nov 28 06:50:10 user nova-compute[74870]:     <memballoon model='virtio'>
Nov 28 06:50:10 user nova-compute[74870]:       <stats period='10'/>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='balloon0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </memballoon>
Nov 28 06:50:10 user nova-compute[74870]:     <rng model='virtio'>
Nov 28 06:50:10 user nova-compute[74870]:       <backend model='random'>/dev/urandom</backend>
Nov 28 06:50:10 user nova-compute[74870]:       <alias name='rng0'/>
Nov 28 06:50:10 user nova-compute[74870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 06:50:10 user nova-compute[74870]:     </rng>
Nov 28 06:50:10 user nova-compute[74870]:   </devices>
Nov 28 06:50:10 user nova-compute[74870]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 06:50:10 user nova-compute[74870]:     <label>libvirt-75046337-1afd-4458-a305-9922679ce7e3</label>
Nov 28 06:50:10 user nova-compute[74870]:     <imagelabel>libvirt-75046337-1afd-4458-a305-9922679ce7e3</imagelabel>
Nov 28 06:50:10 user nova-compute[74870]:   </seclabel>
Nov 28 06:50:10 user nova-compute[74870]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 06:50:10 user nova-compute[74870]:     <label>+64055:+108</label>
Nov 28 06:50:10 user nova-compute[74870]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 06:50:10 user nova-compute[74870]:   </seclabel>
Nov 28 06:50:10 user nova-compute[74870]: </domain>
Nov 28 06:50:10 user nova-compute[74870]:  {{(pid=74870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 06:50:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully detached device tapf6b43f71-00 from instance 75046337-1afd-4458-a305-9922679ce7e3 from the live domain config.
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "f6b43f71-0053-4685-829d-52a0eda846b6", "address": "fa:16:3e:06:b8:09", "network": {"id": "602314ac-ba40-444e-ab59-79363f9eeecb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-433122449", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b43f71-00", "ovs_interfaceid": "f6b43f71-0053-4685-829d-52a0eda846b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_vif [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6b43f71-00, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51c0fc3a-bb63-44fb-867b-105faf89e3af) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:10 user nova-compute[74870]: INFO os_vif [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:09,bridge_name='br-int',has_traffic_filtering=True,id=f6b43f71-0053-4685-829d-52a0eda846b6,network=Network(602314ac-ba40-444e-ab59-79363f9eeecb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b43f71-00')
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:50:10 user nova-compute[74870]:   <nova:package version="0.0.0"/>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:name>tempest-device-tagging-server-1048812053</nova:name>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:creationTime>2023-11-28 06:50:10</nova:creationTime>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:flavor name="m1.tiny">
Nov 28 06:50:10 user nova-compute[74870]:     <nova:memory>512</nova:memory>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:disk>1</nova:disk>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:swap>0</nova:swap>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:vcpus>1</nova:vcpus>
Nov 28 06:50:10 user nova-compute[74870]:   </nova:flavor>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:owner>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:user uuid="dde6b091a2134b83806602165f723ade">tempest-TaggedAttachmentsTest-2015143516-project-member</nova:user>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:project uuid="898c9652da6145af82836b639c44458d">tempest-TaggedAttachmentsTest-2015143516</nova:project>
Nov 28 06:50:10 user nova-compute[74870]:   </nova:owner>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:50:10 user nova-compute[74870]:   <nova:ports>
Nov 28 06:50:10 user nova-compute[74870]:     <nova:port uuid="e51be746-1419-4a95-8bc6-bcf4ed942927">
Nov 28 06:50:10 user nova-compute[74870]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 06:50:10 user nova-compute[74870]:     </nova:port>
Nov 28 06:50:10 user nova-compute[74870]:   </nova:ports>
Nov 28 06:50:10 user nova-compute[74870]: </nova:instance>
Nov 28 06:50:10 user nova-compute[74870]:  {{(pid=74870) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7920fdec-3a26-4d40-8347-848ad28a92da]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260]
Nov 28 06:50:10 user nova-compute[74870]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedf3672-4a98-40f4-b165-68ab4b09dad5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== disconnect_volume: return (362ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.318s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:10 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:50:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmvOEzkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f828d680-8160-49ff-8816-2a7dc274f214]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:50:10 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276e5c9-afe2-4c1a-8872-34c644184229]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b] added
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08967a3-6e4b-411b-90d5-63195533b82e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a48ff6-f043-490f-bf28-3a3cde607ea0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPNUvdgX {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPNUvdgX" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b62a1-ed0e-4398-bc29-8cca760ca4ca]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPNUvdgX'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e724ec-5a2d-442d-af81-90027038600e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f44af-dd12-415c-a9b0-c3f8078eb84b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae419e85-f80f-4790-902e-a4f34bfa4772]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260]
Nov 28 06:50:10 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e2e42-1d83-486e-a895-3d1985f03682]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebdbbeb-06e3-43ee-852a-55c0bdec8763]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:10 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45fe0de-a172-4b57-8daa-26c94fa08d68]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:50:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquired lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:50:11 user nova-compute[74870]: INFO nova.network.neutron [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Port f6b43f71-0053-4685-829d-52a0eda846b6 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 28 06:50:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [{"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Releasing lock "refresh_cache-75046337-1afd-4458-a305-9922679ce7e3" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "interface-75046337-1afd-4458-a305-9922679ce7e3-f6b43f71-0053-4685-829d-52a0eda846b6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.431s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-deleted-f6b43f71-0053-4685-829d-52a0eda846b6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== connect_volume: return (1667ms) {'type': 'block', 'scsi_wwn': '23936313966363064', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936313966363064', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.345s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1304545091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1304545091',id=32,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-yej7ft2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:49:55Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=3a328017-e6a2-4b35-a18d-d51a14e29895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[918f0101-74ac-4bb6-ac5a-6b07504f7586]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:50:12 user nova-compute[74870]: No targets found.
Nov 28 06:50:12 user nova-compute[74870]: iSNS:
Nov 28 06:50:12 user nova-compute[74870]: No targets found.
Nov 28 06:50:12 user nova-compute[74870]: STATIC:
Nov 28 06:50:12 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:50:12 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:12 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:12 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:50:12 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:12 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:12 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b
Nov 28 06:50:12 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:12 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:12 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:50:12 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:12 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:12 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:50:12 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:12 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:12 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:50:12 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:50:12 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:50:12 user nova-compute[74870]: FIRMWARE:
Nov 28 06:50:12 user nova-compute[74870]: No targets found.
Nov 28 06:50:12 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:50:12 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:50:12 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:50:12 user nova-compute[74870]:   <uuid>3a328017-e6a2-4b35-a18d-d51a14e29895</uuid>
Nov 28 06:50:12 user nova-compute[74870]:   <name>instance-00000020</name>
Nov 28 06:50:12 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:50:12 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:50:12 user nova-compute[74870]:   <metadata>
Nov 28 06:50:12 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:50:12 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:50:12 user nova-compute[74870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1304545091</nova:name>
Nov 28 06:50:12 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:50:10</nova:creationTime>
Nov 28 06:50:12 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:50:12 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:50:12 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:50:12 user nova-compute[74870]:       <nova:owner>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:user uuid="c13b793a926942e88fc3416cf3fa005e">tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member</nova:user>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:project uuid="a07e9312175c4e73aa29a51865d61ebd">tempest-ServerBootFromVolumeStableRescueTest-397751332</nova:project>
Nov 28 06:50:12 user nova-compute[74870]:       </nova:owner>
Nov 28 06:50:12 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:50:12 user nova-compute[74870]:       <nova:ports>
Nov 28 06:50:12 user nova-compute[74870]:         <nova:port uuid="afd5f93d-f360-467a-9e4c-b7816bcd41ae">
Nov 28 06:50:12 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:50:12 user nova-compute[74870]:         </nova:port>
Nov 28 06:50:12 user nova-compute[74870]:       </nova:ports>
Nov 28 06:50:12 user nova-compute[74870]:     </nova:instance>
Nov 28 06:50:12 user nova-compute[74870]:   </metadata>
Nov 28 06:50:12 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:50:12 user nova-compute[74870]:     <system>
Nov 28 06:50:12 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:50:12 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:50:12 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:50:12 user nova-compute[74870]:       <entry name="serial">3a328017-e6a2-4b35-a18d-d51a14e29895</entry>
Nov 28 06:50:12 user nova-compute[74870]:       <entry name="uuid">3a328017-e6a2-4b35-a18d-d51a14e29895</entry>
Nov 28 06:50:12 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:50:12 user nova-compute[74870]:     </system>
Nov 28 06:50:12 user nova-compute[74870]:   </sysinfo>
Nov 28 06:50:12 user nova-compute[74870]:   <os>
Nov 28 06:50:12 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:50:12 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:50:12 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:50:12 user nova-compute[74870]:   </os>
Nov 28 06:50:12 user nova-compute[74870]:   <features>
Nov 28 06:50:12 user nova-compute[74870]:     <acpi/>
Nov 28 06:50:12 user nova-compute[74870]:     <apic/>
Nov 28 06:50:12 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:50:12 user nova-compute[74870]:   </features>
Nov 28 06:50:12 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:50:12 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:50:12 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:50:12 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:50:12 user nova-compute[74870]:   </clock>
Nov 28 06:50:12 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:50:12 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:50:12 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:50:12 user nova-compute[74870]:   </cpu>
Nov 28 06:50:12 user nova-compute[74870]:   <devices>
Nov 28 06:50:12 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:50:12 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:50:12 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:50:12 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:50:12 user nova-compute[74870]:       <serial>d49686c2-d776-448d-ad9b-8e0fc72e9d2b</serial>
Nov 28 06:50:12 user nova-compute[74870]:     </disk>
Nov 28 06:50:12 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:50:12 user nova-compute[74870]:       <mac address="fa:16:3e:f3:c9:07"/>
Nov 28 06:50:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:50:12 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:50:12 user nova-compute[74870]:       <target dev="tapafd5f93d-f3"/>
Nov 28 06:50:12 user nova-compute[74870]:     </interface>
Nov 28 06:50:12 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:50:12 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/console.log" append="off"/>
Nov 28 06:50:12 user nova-compute[74870]:     </serial>
Nov 28 06:50:12 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:50:12 user nova-compute[74870]:     <video>
Nov 28 06:50:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:50:12 user nova-compute[74870]:     </video>
Nov 28 06:50:12 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:50:12 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:50:12 user nova-compute[74870]:     </rng>
Nov 28 06:50:12 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:50:12 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:50:12 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:50:12 user nova-compute[74870]:     </memballoon>
Nov 28 06:50:12 user nova-compute[74870]:   </devices>
Nov 28 06:50:12 user nova-compute[74870]: </domain>
Nov 28 06:50:12 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1304545091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1304545091',id=32,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-yej7ft2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:49:55Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=3a328017-e6a2-4b35-a18d-d51a14e29895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_vif [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7486c5fb-026d-4ad1-b7e6-6a56e3398203]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd29a7da1-9deb-501d-97af-bd55f11eabd3', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafd5f93d-f3, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafd5f93d-f3, col_values=(('qos', UUID('95ef6824-9e01-458d-a644-fc20c522be8e')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafd5f93d-f3, col_values=(('external_ids', {'iface-id': 'afd5f93d-f360-467a-9e4c-b7816bcd41ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:c9:07', 'vm-uuid': '3a328017-e6a2-4b35-a18d-d51a14e29895'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:12 user nova-compute[74870]: INFO os_vif [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3')
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf5e7a-40da-44a0-978a-fc867f746d04]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:12 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:12 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:12 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc324160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b'): ({'sde'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Removing single pathed devices sde {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d4a8d-06bf-422b-b8d3-e18bdc9cb07d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28274a2a-4879-479f-8893-0f686a12b974]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flushing IO for device /dev/sde {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2215a3f-adc3-40cd-9bfa-8851deebd705]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No VIF found with MAC fa:16:3e:f3:c9:07, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1f5f5-0227-415c-9acc-d5abea0cfd4c]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40936558-f5e6-4969-b5f5-d92914e396ef]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a9449-6950-457a-b681-222a372a3ba3]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260]
Nov 28 06:50:12 user nova-compute[74870]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:12 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96aa8851-3cdf-43b9-a69e-891d458bf78b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba91cf-ea13-4bab-82b3-969a71eb3ff7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] <== disconnect_volume: return (1689ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:50:12 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Deleting instance files /opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f_del
Nov 28 06:50:12 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Deletion of /opt/stack/data/nova/instances/c7a2db07-1739-4fa5-b444-86d602ca586f_del complete
Nov 28 06:50:12 user nova-compute[74870]: INFO nova.compute.manager [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Took 5.33 seconds to destroy the instance on the hypervisor.
Nov 28 06:50:12 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:50:12 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:13 user nova-compute[74870]: WARNING nova.compute.manager [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state building and task_state spawning.
Nov 28 06:50:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-deleted-40d74d10-744b-4187-8a27-c72bfc4b1a47 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:14 user nova-compute[74870]: INFO nova.compute.manager [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Neutron deleted interface 40d74d10-744b-4187-8a27-c72bfc4b1a47; detaching it from the instance and deleting it from the info cache
Nov 28 06:50:14 user nova-compute[74870]: DEBUG nova.network.neutron [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [{"id": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "address": "fa:16:3e:1c:7a:a8", "network": {"id": "4017cd74-3c8e-48cb-a991-090413120603", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1361254590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce346bd0-6d", "ovs_interfaceid": "ce346bd0-6d5d-45d0-9165-4da3207ce081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "address": "fa:16:3e:ec:7e:76", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57870541-c5", "ovs_interfaceid": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "address": "fa:16:3e:12:3d:31", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5dfb04-4a", "ovs_interfaceid": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0314f996-11e4-4335-8088-c85a9ec88931", "address": "fa:16:3e:e1:31:1f", "network": {"id": "ceec40e5-bc75-4dae-9329-401faa72d72b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1368005409", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0314f996-11", "ovs_interfaceid": "0314f996-11e4-4335-8088-c85a9ec88931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "address": "fa:16:3e:76:37:38", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ab023f9-1a", "ovs_interfaceid": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "address": "fa:16:3e:45:8f:85", "network": {"id": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "bridge": "br-int", "label": "tempest-device-tagging-net2-361315005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "24232ad48c7c4b6c94efc23f0682247f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a310b8-79", "ovs_interfaceid": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Detach interface failed, port_id=40d74d10-744b-4187-8a27-c72bfc4b1a47, reason: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:50:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:50:15 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance spawned successfully.
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:15 user nova-compute[74870]: WARNING nova.compute.manager [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state building and task_state spawning.
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:15 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Took 3.50 seconds to deallocate network for instance.
Nov 28 06:50:15 user nova-compute[74870]: INFO nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 28 06:50:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:50:16 user nova-compute[74870]: INFO nova.compute.manager [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Took 21.88 seconds to build instance.
Nov 28 06:50:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.022s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-deleted-8ab023f9-1a91-43d1-a020-8ecd1a6eafaf {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-deleted-c1a310b8-79bf-4098-a7f8-0f1736c5dd79 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-deleted-ce346bd0-6d5d-45d0-9165-4da3207ce081 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Received event network-vif-deleted-0314f996-11e4-4335-8088-c85a9ec88931 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:17 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:18 user nova-compute[74870]: INFO nova.compute.manager [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Took 2.87 seconds to detach 3 volumes for instance.
Nov 28 06:50:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:19 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:50:19 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:50:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:19 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Deleted allocations for instance c7a2db07-1739-4fa5-b444-86d602ca586f
Nov 28 06:50:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "c7a2db07-1739-4fa5-b444-86d602ca586f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.384s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:50:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7082MB free_disk=25.17337417602539GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 75046337-1afd-4458-a305-9922679ce7e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance ab422771-7c11-4074-b4a6-d793c790e813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:50:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating instance_info_cache with network_info: [{"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-eea1149f-7553-4beb-b8df-87822bd3abd5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:50:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:50:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-changed-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Refreshing instance network info cache due to event network-changed-5dce38d6-cf1d-4a63-a798-fa9bc36f7418. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:50:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Acquiring lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Acquired lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:34 user nova-compute[74870]: DEBUG nova.network.neutron [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Refreshing network info cache for port 5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG nova.network.neutron [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updated VIF entry in instance network info cache for port 5dce38d6-cf1d-4a63-a798-fa9bc36f7418. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG nova.network.neutron [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updating instance_info_cache with network_info: [{"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Releasing lock "refresh_cache-ab422771-7c11-4074-b4a6-d793c790e813" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'flavor' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:36 user nova-compute[74870]: INFO nova.compute.manager [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attaching volume 099bd1dc-45f7-4f2f-9e1f-f47124112712 to /dev/vdb
Nov 28 06:50:36 user nova-compute[74870]: DEBUG os_brick.utils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ebe6c-55fa-4ddf-b135-ba367c2427ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a14a1-12d9-470b-9f63-cfe4a2fa6bc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c817911-8aea-42f9-a47f-b6e795a90a4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[507edfd0-75bc-4f8e-8509-bc15defdec1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:36 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:50:36 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f68103-832d-41d0-8457-99c31ae133a1]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG os_brick.utils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:36 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updating existing volume attachment record: ef7fb0df-dba5-444b-9258-a8af8666b715 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:50:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:41 user nova-compute[74870]: INFO nova.compute.manager [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Terminating instance
Nov 28 06:50:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-unplugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-unplugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-unplugged-e51be746-1419-4a95-8bc6-bcf4ed942927 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Instance destroyed successfully.
Nov 28 06:50:42 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'resources' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T06:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1048812053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1048812053',id=28,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw==',key_name='tempest-keypair-847145216',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='898c9652da6145af82836b639c44458d',ramdisk_id='',reservation_id='r-efe64m1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2015143516',owner_user_name='tempest-TaggedAttachmentsTest-2015143516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dde6b091a2134b83806602165f723ade',uuid=75046337-1afd-4458-a305-9922679ce7e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converting VIF {"id": "e51be746-1419-4a95-8bc6-bcf4ed942927", "address": "fa:16:3e:5a:8e:ad", "network": {"id": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1871360000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "898c9652da6145af82836b639c44458d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape51be746-14", "ovs_interfaceid": "e51be746-1419-4a95-8bc6-bcf4ed942927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG os_vif [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape51be746-14, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc039804-1c4a-46f6-b4a5-4c0fe3c27b9f) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:50:42 user nova-compute[74870]: INFO os_vif [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:8e:ad,bridge_name='br-int',has_traffic_filtering=True,id=e51be746-1419-4a95-8bc6-bcf4ed942927,network=Network(879e4b3b-c11a-4821-9bcf-c6f334a9c2f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51be746-14')
Nov 28 06:50:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Deleting instance files /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3_del
Nov 28 06:50:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Deletion of /opt/stack/data/nova/instances/75046337-1afd-4458-a305-9922679ce7e3_del complete
Nov 28 06:50:42 user nova-compute[74870]: INFO nova.compute.manager [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 06:50:42 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:50:42 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 75046337-1afd-4458-a305-9922679ce7e3] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:43 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Took 0.71 seconds to deallocate network for instance.
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-deleted-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:43 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Deleted allocations for instance 75046337-1afd-4458-a305-9922679ce7e3
Nov 28 06:50:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "75046337-1afd-4458-a305-9922679ce7e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-changed-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Refreshing instance network info cache due to event network-changed-b7c5e041-ed7b-4c47-96b6-dbebd8356786. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Acquiring lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Acquired lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:43 user nova-compute[74870]: DEBUG nova.network.neutron [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Refreshing network info cache for port b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received event network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Acquiring lock "75046337-1afd-4458-a305-9922679ce7e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Lock "75046337-1afd-4458-a305-9922679ce7e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] No waiting events found dispatching network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:44 user nova-compute[74870]: WARNING nova.compute.manager [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Received unexpected event network-vif-plugged-e51be746-1419-4a95-8bc6-bcf4ed942927 for instance with vm_state deleted and task_state None.
Nov 28 06:50:44 user nova-compute[74870]: DEBUG nova.network.neutron [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updated VIF entry in instance network info cache for port b7c5e041-ed7b-4c47-96b6-dbebd8356786. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG nova.network.neutron [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updating instance_info_cache with network_info: [{"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Releasing lock "refresh_cache-c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsjPkSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:46 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:46 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:46 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ac2e5-29b4-4d8b-8651-441b7d5b654e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:50:46 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a23a5-26a0-4d83-b5fe-a602b24e1412]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712] added
Nov 28 06:50:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.130s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ea017c-1f8b-4a64-90ee-505da80e93a0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac89c4-1b5d-4f59-ba0d-c2d390b38cc7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znsjPkSl {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znsjPkSl" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1ee65a-7fad-4335-abd7-bfd34e383341]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'znsjPkSl'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd834746-13fe-4f45-a926-f3dc727f5f39]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bda72-84dc-45b7-bfc9-4efca9f8f6c4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:46 user nova-compute[74870]: INFO nova.compute.manager [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Attaching volume 742921c3-d954-4a45-a388-876267a6379d to /dev/vdb
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.utils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[905deda8-4a2a-4ad0-98ce-526873090446]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260]
Nov 28 06:50:46 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556a6b1-ba3a-4ac9-b2a3-df245cb79ff7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f243e-d5a2-40f6-96cc-99583ad66081]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[619957c0-c310-486b-8568-0b6b308fb6cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88991bc-e05e-451b-b1e9-e0a19e1d8ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f6586-3c1a-4a7c-85ac-c07d07dfe60d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:46 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a99066-bd22-4fe2-9414-3fe1ae92350a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1319093f-dab3-40e3-9928-66e97343e804]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsjPkSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:46 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:50:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c270038b-276e-40f7-8355-0e48339ef7a3]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG os_brick.utils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:46 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updating existing volume attachment record: a7397b18-1eb3-4174-bae4-f2585e97c39f {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:50:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:47 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:47 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '23533353435366661', 'path': '/dev/sde'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533353435366661', 'path': '/dev/sde'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:50:47 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'flavor' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:50:48 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:50:48 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:50:48 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:50:48 user nova-compute[74870]:   <serial>099bd1dc-45f7-4f2f-9e1f-f47124112712</serial>
Nov 28 06:50:48 user nova-compute[74870]: </disk>
Nov 28 06:50:48 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:50:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:50:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:50:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No VIF found with MAC fa:16:3e:3a:66:42, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:50:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.488s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:49 user nova-compute[74870]: INFO nova.compute.manager [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Unrescuing
Nov 28 06:50:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:50:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:50:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:50:50 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:50:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:50:50 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:51 user nova-compute[74870]: WARNING nova.compute.manager [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:50:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'flavor' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:51 user nova-compute[74870]: INFO nova.compute.manager [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attaching volume 36d2fb26-6898-433b-8c8e-7818cf21bd13 to /dev/vdc
Nov 28 06:50:51 user nova-compute[74870]: DEBUG os_brick.utils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f11261-1ed0-45a8-8f9d-e4678c4e4267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e1c95-baf6-41c2-b95b-f3fc17ea5e95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance destroyed successfully.
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7265943-13c7-40a7-95dc-a6f7ab9ee5a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea7d3e-5450-4c88-a815-5e9e5809843a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:50:51 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:50:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ae2b0-38c8-4f9b-a95c-04cde8fcce39]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG os_brick.utils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:51 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updating existing volume attachment record: 1ca3d472-e4ee-4f72-83ac-92e7a2f9cc26 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:50:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:53 user nova-compute[74870]: WARNING nova.compute.manager [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:50:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:53 user nova-compute[74870]: WARNING nova.compute.manager [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:50:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfxYPwoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:54 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4db5d4d-6d16-4702-8970-a7b2b724b2d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:50:54 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5406e2da-32a0-41ec-b9eb-714d559ff22a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d] added
Nov 28 06:50:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ef737-9081-4749-a54e-89f53db372f3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadc3883-6eee-4954-b75b-ba3a4cc6d520]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfxYPwoH {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfxYPwoH" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e486cf-a623-40eb-8082-b7041e7754a3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rfxYPwoH'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[007bf6de-ddad-4f9c-8b9d-438ae1d31c25]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f9148-31fb-4cc5-b78b-62e3f73bcafe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bde2394-0371-4353-9df2-f0c815adc3b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260]
Nov 28 06:50:54 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56578404-a017-4d00-8405-9ac101ad41e3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e40f6-12f8-4797-8a51-de11e80e8f4b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:50:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:54 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:50:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf680d-bedb-492b-80ea-bc5b8de929c4]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:50:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfxYPwoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:50:55 user nova-compute[74870]: WARNING nova.compute.manager [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state active and task_state None.
Nov 28 06:50:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23964356364643538', 'path': '/dev/sdf'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964356364643538', 'path': '/dev/sdf'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:50:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:50:55 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:50:55 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:50:55 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:50:55 user nova-compute[74870]:   <serial>742921c3-d954-4a45-a388-876267a6379d</serial>
Nov 28 06:50:55 user nova-compute[74870]: </disk>
Nov 28 06:50:55 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:50:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:50:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:50:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] No VIF found with MAC fa:16:3e:02:0a:ef, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:50:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.797s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:50:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:50:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:50:57 user nova-compute[74870]: INFO nova.compute.manager [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Detaching volume 742921c3-d954-4a45-a388-876267a6379d
Nov 28 06:50:58 user nova-compute[74870]: INFO nova.virt.block_device [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Attempting to driver detach volume 742921c3-d954-4a45-a388-876267a6379d from mountpoint /dev/vdb
Nov 28 06:50:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Attempting to detach device vdb from instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:50:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:50:58 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:50:58 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:50:58 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:50:58 user nova-compute[74870]:   <serial>742921c3-d954-4a45-a388-876267a6379d</serial>
Nov 28 06:50:58 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:50:58 user nova-compute[74870]: </disk>
Nov 28 06:50:58 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:50:58 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully detached device vdb from instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db from the persistent domain config.
Nov 28 06:50:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:50:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:50:58 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:50:58 user nova-compute[74870]:   <source dev="/dev/sdf"/>
Nov 28 06:50:58 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:50:58 user nova-compute[74870]:   <serial>742921c3-d954-4a45-a388-876267a6379d</serial>
Nov 28 06:50:58 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:50:58 user nova-compute[74870]: </disk>
Nov 28 06:50:58 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:50:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmRQcIjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:50:59 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:59 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:50:59 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dbb8be-2b2b-4152-826b-81c32761a3eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:50:59 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e811a53-543b-491b-896a-11d99909b769]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13] added
Nov 28 06:50:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7710c4c-394c-4589-9251-d4b658301656]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f79d508-dc07-434f-b5a6-5205df5b1bd9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmRQcIjD {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmRQcIjD" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a217efd3-3d8a-4c3a-af3a-19a19e620a14]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmRQcIjD'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c1f0c-1238-472b-bc33-f39d6b852994]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52168343-8839-4179-a79d-abbaa9f50300]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:50:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:50:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[81197aab-3a69-40e5-817b-8be54f50d988]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260]
Nov 28 06:50:59 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260] successful.
Nov 28 06:50:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed500b0-db74-4b06-a894-9657fa34a79a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd800a-366e-4bc4-846f-95d2afd87b33]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:50:59 user nova-compute[74870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)
Nov 28 06:50:59 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] HCTL ('40', '-', '-', 0) found on session 38 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d1cdd4-b1ad-4b43-84aa-47893f7d0d9d]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:50:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmRQcIjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:51:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:00 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:00 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26239383066633233', 'path': '/dev/sdi'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:51:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239383066633233', 'path': '/dev/sdi'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:51:00 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'flavor' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:51:00 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:00 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:51:00 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:51:00 user nova-compute[74870]:   <serial>36d2fb26-6898-433b-8c8e-7818cf21bd13</serial>
Nov 28 06:51:00 user nova-compute[74870]: </disk>
Nov 28 06:51:00 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:51:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:51:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:51:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:51:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] No VIF found with MAC fa:16:3e:3a:66:42, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:51:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.055s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:02 user nova-compute[74870]: INFO nova.compute.manager [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Detaching volume 36d2fb26-6898-433b-8c8e-7818cf21bd13
Nov 28 06:51:02 user nova-compute[74870]: INFO nova.virt.block_device [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attempting to driver detach volume 36d2fb26-6898-433b-8c8e-7818cf21bd13 from mountpoint /dev/vdc
Nov 28 06:51:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Attempting to detach device vdc from instance ab422771-7c11-4074-b4a6-d793c790e813 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:51:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:02 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:02 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:51:02 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:51:02 user nova-compute[74870]:   <serial>36d2fb26-6898-433b-8c8e-7818cf21bd13</serial>
Nov 28 06:51:02 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 06:51:02 user nova-compute[74870]: </disk>
Nov 28 06:51:02 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Successfully detached device vdc from instance ab422771-7c11-4074-b4a6-d793c790e813 from the persistent domain config.
Nov 28 06:51:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ab422771-7c11-4074-b4a6-d793c790e813 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:51:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:02 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:02 user nova-compute[74870]:   <source dev="/dev/sdi"/>
Nov 28 06:51:02 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:51:02 user nova-compute[74870]:   <serial>36d2fb26-6898-433b-8c8e-7818cf21bd13</serial>
Nov 28 06:51:02 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 06:51:02 user nova-compute[74870]: </disk>
Nov 28 06:51:02 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:51:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:16 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:17 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:18 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db is timed out.
Nov 28 06:51:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully detached device vdb from instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db from the live domain config.
Nov 28 06:51:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfxYPwoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:51:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdb790-d807-44da-b151-ae27ffc06865]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:51:18 user nova-compute[74870]: No targets found.
Nov 28 06:51:18 user nova-compute[74870]: iSNS:
Nov 28 06:51:18 user nova-compute[74870]: No targets found.
Nov 28 06:51:18 user nova-compute[74870]: STATIC:
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:51:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:18 user nova-compute[74870]: FIRMWARE:
Nov 28 06:51:18 user nova-compute[74870]: No targets found.
Nov 28 06:51:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:51:18 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:51:18 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e14ae93-1733-4805-91a9-14e0aa1e0e97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ca97dd-6ea3-4cf9-811f-a51aa0d93fff]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d (non-flash)
Nov 28 06:51:18 user nova-compute[74870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)
Nov 28 06:51:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc46b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d'): ({'sdf'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Removing single pathed devices sdf {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efc1111-3973-4d61-8003-292d12b0170d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b6957f-9d9a-4119-8a48-604f5adb4ea7]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flushing IO for device /dev/sdf {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[796763ae-82e7-4de7-b449-b2db7421aa81]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe708613-980c-45fa-bbe9-2254d05c1535]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] SCSI volumes sdf have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab2e6de-a60c-4888-a9e2-630ebf33f659]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cdd8ea-a447-48a9-b4ab-d815d5591ebc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260]
Nov 28 06:51:18 user nova-compute[74870]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d, portal: 172.16.0.220,3260] successful.
Nov 28 06:51:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:742921c3-d954-4a45-a388-876267a6379d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[08466bc9-acaf-48d8-9166-9b15e65e9108]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] <== disconnect_volume: return (431ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:51:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:51:19 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:19 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'flavor' on Instance uuid c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.907s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ab422771-7c11-4074-b4a6-d793c790e813 is timed out.
Nov 28 06:51:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Successfully detached device vdc from instance ab422771-7c11-4074-b4a6-d793c790e813 from the live domain config.
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmRQcIjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:51:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c72bcb8-cc5f-476c-b060-45f623891f0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:51:23 user nova-compute[74870]: No targets found.
Nov 28 06:51:23 user nova-compute[74870]: iSNS:
Nov 28 06:51:23 user nova-compute[74870]: No targets found.
Nov 28 06:51:23 user nova-compute[74870]: STATIC:
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:51:23 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:23 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:23 user nova-compute[74870]: FIRMWARE:
Nov 28 06:51:23 user nova-compute[74870]: No targets found.
Nov 28 06:51:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:51:23 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:51:23 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba42dac4-0a17-4459-8537-3eae43d1a5f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7333464-b0c9-4f6f-a132-b6b6cb06826d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 (non-flash)
Nov 28 06:51:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc558a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13'): ({'sdi'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Removing single pathed devices sdi {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943965a-9b9f-4591-9264-f6664f122377]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc80b62e-41c5-46e7-9e7f-daf6073a5956]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Flushing IO for device /dev/sdi {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5b9a9-472d-4465-852a-1315bb6a0efe]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c68fc1-efa9-4ddf-858d-9b98cc804d8f]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] SCSI volumes sdi have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b851e2ab-dbdc-492c-af3d-e59ab736f1ab]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b022a8-3f47-4acb-993a-7a78277ad634]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260]
Nov 28 06:51:23 user nova-compute[74870]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13, portal: 172.16.0.220,3260] successful.
Nov 28 06:51:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d2fb26-6898-433b-8c8e-7818cf21bd13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcd67b0-2935-4a2a-833d-3715c373fd44]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] <== disconnect_volume: return (374ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:23 user nova-compute[74870]: INFO nova.compute.manager [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Detaching volume 0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:51:23 user nova-compute[74870]: INFO nova.virt.block_device [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Attempting to driver detach volume 0ceba6e2-fc04-4dc6-ab19-055561d21e27 from mountpoint /dev/vdb
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Attempting to detach device vdb from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:23 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:23 user nova-compute[74870]:   <source dev="/dev/sdh"/>
Nov 28 06:51:23 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:51:23 user nova-compute[74870]:   <serial>0ceba6e2-fc04-4dc6-ab19-055561d21e27</serial>
Nov 28 06:51:23 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 06:51:23 user nova-compute[74870]: </disk>
Nov 28 06:51:23 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully detached device vdb from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa from the persistent domain config.
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:23 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:23 user nova-compute[74870]:   <source dev="/dev/sdh"/>
Nov 28 06:51:23 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:51:23 user nova-compute[74870]:   <serial>0ceba6e2-fc04-4dc6-ab19-055561d21e27</serial>
Nov 28 06:51:23 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 06:51:23 user nova-compute[74870]: </disk>
Nov 28 06:51:23 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG nova.objects.instance [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'flavor' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.801s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:51:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:25 user nova-compute[74870]: INFO nova.compute.manager [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Detaching volume 142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:51:25 user nova-compute[74870]: INFO nova.virt.block_device [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Attempting to driver detach volume 142a655f-e1de-4c08-b7e5-e81e50cf760f from mountpoint /dev/vdb
Nov 28 06:51:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Attempting to detach device vdb from instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:25 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:25 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 06:51:25 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:51:25 user nova-compute[74870]:   <serial>142a655f-e1de-4c08-b7e5-e81e50cf760f</serial>
Nov 28 06:51:25 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 06:51:25 user nova-compute[74870]: </disk>
Nov 28 06:51:25 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:25 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully detached device vdb from instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d from the persistent domain config.
Nov 28 06:51:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:25 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:25 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 06:51:25 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:51:25 user nova-compute[74870]:   <serial>142a655f-e1de-4c08-b7e5-e81e50cf760f</serial>
Nov 28 06:51:25 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 06:51:25 user nova-compute[74870]: </disk>
Nov 28 06:51:25 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:51:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7179MB free_disk=25.161605834960938GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance ab422771-7c11-4074-b4a6-d793c790e813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:51:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:51:27 user nova-compute[74870]: INFO nova.compute.claims [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Claim successful on node user
Nov 28 06:51:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:51:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.policy [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:51:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Creating image(s)
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.201s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk 1073741824" returned: 0 in 0.228s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.407s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Successfully created port: fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Cannot resize image /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Successfully updated port: fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-changed-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing instance network info cache due to event network-changed-fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance network_info: |[{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.neutron [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing network info cache for port fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Start _get_guest_xml network_info=[{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:51:29 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:51:29 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-161739875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-161739875',id=34,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgppLb2kNYG5hyeE0SEPq0PFajgXAsCK1knJv+jOVeGkDLsXyFItKhJE8Nomj2oA0/dnErgSFuw7MdhLob2xlyJnLrkin+BS1Fq0CIEv5UHpjZO84gELSv312s7eJMXCA==',key_name='tempest-keypair-259314972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-x7x4oe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=4fe14a8c-afa2-43b4-a885-914f4c8195ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.objects.instance [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:51:29 user nova-compute[74870]:   <uuid>4fe14a8c-afa2-43b4-a885-914f4c8195ad</uuid>
Nov 28 06:51:29 user nova-compute[74870]:   <name>instance-00000022</name>
Nov 28 06:51:29 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:51:29 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:51:29 user nova-compute[74870]:   <metadata>
Nov 28 06:51:29 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:51:29 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:51:29 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-161739875</nova:name>
Nov 28 06:51:29 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:51:29</nova:creationTime>
Nov 28 06:51:29 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:51:29 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:51:29 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:51:29 user nova-compute[74870]:       <nova:owner>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:user uuid="dbf659ad4b8f43a2bc497d01be58d846">tempest-AttachVolumeShelveTestJSON-92318211-project-member</nova:user>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:project uuid="9d769a1c976c468f804770d89c92ae94">tempest-AttachVolumeShelveTestJSON-92318211</nova:project>
Nov 28 06:51:29 user nova-compute[74870]:       </nova:owner>
Nov 28 06:51:29 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:51:29 user nova-compute[74870]:       <nova:ports>
Nov 28 06:51:29 user nova-compute[74870]:         <nova:port uuid="fc037856-716e-436b-b551-55cd7f2497cc">
Nov 28 06:51:29 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:51:29 user nova-compute[74870]:         </nova:port>
Nov 28 06:51:29 user nova-compute[74870]:       </nova:ports>
Nov 28 06:51:29 user nova-compute[74870]:     </nova:instance>
Nov 28 06:51:29 user nova-compute[74870]:   </metadata>
Nov 28 06:51:29 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:51:29 user nova-compute[74870]:     <system>
Nov 28 06:51:29 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:51:29 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:51:29 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:51:29 user nova-compute[74870]:       <entry name="serial">4fe14a8c-afa2-43b4-a885-914f4c8195ad</entry>
Nov 28 06:51:29 user nova-compute[74870]:       <entry name="uuid">4fe14a8c-afa2-43b4-a885-914f4c8195ad</entry>
Nov 28 06:51:29 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:51:29 user nova-compute[74870]:     </system>
Nov 28 06:51:29 user nova-compute[74870]:   </sysinfo>
Nov 28 06:51:29 user nova-compute[74870]:   <os>
Nov 28 06:51:29 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:51:29 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:51:29 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:51:29 user nova-compute[74870]:   </os>
Nov 28 06:51:29 user nova-compute[74870]:   <features>
Nov 28 06:51:29 user nova-compute[74870]:     <acpi/>
Nov 28 06:51:29 user nova-compute[74870]:     <apic/>
Nov 28 06:51:29 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:51:29 user nova-compute[74870]:   </features>
Nov 28 06:51:29 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:51:29 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:51:29 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:51:29 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:51:29 user nova-compute[74870]:   </clock>
Nov 28 06:51:29 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:51:29 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:51:29 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:51:29 user nova-compute[74870]:   </cpu>
Nov 28 06:51:29 user nova-compute[74870]:   <devices>
Nov 28 06:51:29 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:51:29 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:51:29 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk"/>
Nov 28 06:51:29 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:51:29 user nova-compute[74870]:     </disk>
Nov 28 06:51:29 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:51:29 user nova-compute[74870]:       <mac address="fa:16:3e:6b:86:96"/>
Nov 28 06:51:29 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:51:29 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:51:29 user nova-compute[74870]:       <target dev="tapfc037856-71"/>
Nov 28 06:51:29 user nova-compute[74870]:     </interface>
Nov 28 06:51:29 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:51:29 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/console.log" append="off"/>
Nov 28 06:51:29 user nova-compute[74870]:     </serial>
Nov 28 06:51:29 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:51:29 user nova-compute[74870]:     <video>
Nov 28 06:51:29 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:51:29 user nova-compute[74870]:     </video>
Nov 28 06:51:29 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:51:29 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:51:29 user nova-compute[74870]:     </rng>
Nov 28 06:51:29 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:51:29 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:51:29 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:51:29 user nova-compute[74870]:     </memballoon>
Nov 28 06:51:29 user nova-compute[74870]:   </devices>
Nov 28 06:51:29 user nova-compute[74870]: </domain>
Nov 28 06:51:29 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-161739875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-161739875',id=34,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgppLb2kNYG5hyeE0SEPq0PFajgXAsCK1knJv+jOVeGkDLsXyFItKhJE8Nomj2oA0/dnErgSFuw7MdhLob2xlyJnLrkin+BS1Fq0CIEv5UHpjZO84gELSv312s7eJMXCA==',key_name='tempest-keypair-259314972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-x7x4oe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=4fe14a8c-afa2-43b4-a885-914f4c8195ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG os_vif [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe4cc634-8989-5c84-8079-1c383c4c820c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc037856-71, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc037856-71, col_values=(('qos', UUID('6c9638b0-5ae4-4938-9dc6-c1809415aa67')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc037856-71, col_values=(('external_ids', {'iface-id': 'fc037856-716e-436b-b551-55cd7f2497cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:86:96', 'vm-uuid': '4fe14a8c-afa2-43b4-a885-914f4c8195ad'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:29 user nova-compute[74870]: INFO os_vif [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71')
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:51:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No VIF found with MAC fa:16:3e:6b:86:96, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:51:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updated VIF entry in instance network info cache for port fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:51:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:31 user nova-compute[74870]: WARNING nova.compute.manager [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state building and task_state spawning.
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:51:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance spawned successfully.
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:33 user nova-compute[74870]: WARNING nova.compute.manager [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state building and task_state spawning.
Nov 28 06:51:33 user nova-compute[74870]: INFO nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 28 06:51:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:51:33 user nova-compute[74870]: INFO nova.compute.manager [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Took 6.58 seconds to build instance.
Nov 28 06:51:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.683s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa is timed out.
Nov 28 06:51:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully detached device vdb from instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa from the live domain config.
Nov 28 06:51:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyIsqnXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:51:44 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ad0ab-a1f4-4e37-9792-29bddce7e50a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:51:44 user nova-compute[74870]: No targets found.
Nov 28 06:51:44 user nova-compute[74870]: iSNS:
Nov 28 06:51:44 user nova-compute[74870]: No targets found.
Nov 28 06:51:44 user nova-compute[74870]: STATIC:
Nov 28 06:51:44 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712
Nov 28 06:51:44 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:44 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:44 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:51:44 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:44 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:44 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:51:44 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:44 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:44 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27
Nov 28 06:51:44 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:44 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:44 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:51:44 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:44 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:44 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:51:44 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:44 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:44 user nova-compute[74870]: FIRMWARE:
Nov 28 06:51:44 user nova-compute[74870]: No targets found.
Nov 28 06:51:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:51:44 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:51:44 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4682a-aaa1-420f-9618-ad5c486db925]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668949a-8814-4bbe-954f-f77b01832cf0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:44 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc7f2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27'): ({'sdh'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Removing single pathed devices sdh {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc9936-e856-4903-92e4-52356fa9f454]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f62a8-37dd-4dd7-a3e8-4123a2169314]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flushing IO for device /dev/sdh {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5109ad-f037-4698-994a-3ea668d0dcd8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67abf98-caf7-451e-8d63-43f1d59ce660]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] SCSI volumes sdh have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13762f0-85e7-436e-bfd2-2f9d8335e984]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b11437-62fa-4e75-b70c-13799342bd35]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260]
Nov 28 06:51:44 user nova-compute[74870]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27, portal: 172.16.0.220,3260] successful.
Nov 28 06:51:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ceba6e2-fc04-4dc6-ab19-055561d21e27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0329e-be9f-4b76-a553-2ecd5e921a75]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== disconnect_volume: return (346ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:51:44 user nova-compute[74870]: INFO nova.compute.manager [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Rescuing
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:51:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'flavor' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG nova.network.neutron [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating instance_info_cache with network_info: [{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:45 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d is timed out.
Nov 28 06:51:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully detached device vdb from instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d from the live domain config.
Nov 28 06:51:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UumbSJsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:51:45 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d82c1-bf5e-4e68-b635-4c4bf745f8db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:51:45 user nova-compute[74870]: No targets found.
Nov 28 06:51:45 user nova-compute[74870]: iSNS:
Nov 28 06:51:45 user nova-compute[74870]: No targets found.
Nov 28 06:51:45 user nova-compute[74870]: STATIC:
Nov 28 06:51:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712
Nov 28 06:51:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:51:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f
Nov 28 06:51:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:51:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:51:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:51:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:51:45 user nova-compute[74870]: FIRMWARE:
Nov 28 06:51:45 user nova-compute[74870]: No targets found.
Nov 28 06:51:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:51:45 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:51:45 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb30100-7054-41fe-8074-829d6cfae60f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6eb215-38ff-470c-bf34-9a355722f20f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:45 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef413a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45db19b-d9ec-4cda-bea3-e562c2b49e96]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92923b97-b26e-4a55-9eb1-60d0070e97ff]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96551e4e-1c59-4f09-8436-783243c543f7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[105acf85-6e08-48cd-8c1d-0992e63ba1cd]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:51:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8048b9df-88f7-4d15-b32a-5cc28e880320]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4395bf-62bc-456c-bb88-dd808b868330]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260]
Nov 28 06:51:46 user nova-compute[74870]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f, portal: 172.16.0.220,3260] successful.
Nov 28 06:51:46 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142a655f-e1de-4c08-b7e5-e81e50cf760f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[74354609-7b18-4b86-bdea-7ef18f39661e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== disconnect_volume: return (382ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:46 user nova-compute[74870]: WARNING nova.compute.manager [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state rescuing.
Nov 28 06:51:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance destroyed successfully.
Nov 28 06:51:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Attempting a stable device rescue
Nov 28 06:51:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:51:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Creating image(s)
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "/opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "e38affa7da923bc59562cad39f8590eb26880401" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e38affa7da923bc59562cad39f8590eb26880401" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:47 user nova-compute[74870]: DEBUG nova.objects.instance [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.part --force-share --output=json" returned: 0 in 0.220s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.images [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 9827cec7-b26b-48dc-9a84-87c46159915f was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.part /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.953s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:48 user nova-compute[74870]: WARNING nova.compute.manager [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state rescuing.
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74870) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.part /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.converted" returned: 0 in 0.269s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:48 user nova-compute[74870]: INFO nova.compute.manager [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Terminating instance
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e38affa7da923bc59562cad39f8590eb26880401" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.755s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:48 user nova-compute[74870]: WARNING nova.compute.manager [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state active and task_state powering-off.
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "e38affa7da923bc59562cad39f8590eb26880401" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e38affa7da923bc59562cad39f8590eb26880401" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401 --force-share --output=json" returned: 0 in 0.202s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401,backing_fmt=raw /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-vif-unplugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] No waiting events found dispatching network-vif-unplugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-vif-unplugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401,backing_fmt=raw /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue" returned: 0 in 0.053s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e38affa7da923bc59562cad39f8590eb26880401" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'migration_context' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<3a328017-e6a2-4b35-a18d-d51a14e29895> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Start _get_guest_xml network_info=[{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "vif_mac": "fa:16:3e:f3:c9:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9827cec7-b26b-48dc-9a84-87c46159915f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3a328017-e6a2-4b35-a18d-d51a14e29895', 'attached_at': '', 'detached_at': '', 'volume_id': 'd49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'serial': 'd49686c2-d776-448d-ad9b-8e0fc72e9d2b'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6274d909-58d3-470d-b540-06cd470c1b0f', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'resources' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<3a328017-e6a2-4b35-a18d-d51a14e29895> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<3a328017-e6a2-4b35-a18d-d51a14e29895> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:51:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:51:48 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.objects.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<3a328017-e6a2-4b35-a18d-d51a14e29895> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:51:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:51:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:51:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:51:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:51:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:51:48 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:51:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f137ae7f-f799-43c4-aae0-398b383d72d2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WPNUvdgX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 06:51:49 user nova-compute[74870]: node.name = iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:51:49 user nova-compute[74870]: node.tpgt = -1
Nov 28 06:51:49 user nova-compute[74870]: node.startup = automatic
Nov 28 06:51:49 user nova-compute[74870]: node.leading_login = No
Nov 28 06:51:49 user nova-compute[74870]: iface.iscsi_ifacename = default
Nov 28 06:51:49 user nova-compute[74870]: iface.net_ifacename = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.ipaddress = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.prefix_len = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.hwaddress = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.transport_name = tcp
Nov 28 06:51:49 user nova-compute[74870]: iface.initiatorname = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.vlan_id = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.vlan_priority = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.vlan_state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.iface_num = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.mtu = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.port = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.bootproto = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.subnet_mask = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.gateway = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_alt_client_id = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_dns = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_learn_iqn = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_vendor_id_state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_vendor_id = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.dhcp_slp_da = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.fragmentation = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.gratuitous_arp = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.incoming_forwarding = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.tos_state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.tos = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.ttl = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.delayed_ack = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.tcp_nagle = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.tcp_wsf_state = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.tcp_wsf = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.tcp_timer_scale = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.tcp_timestamp = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.redirect = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.def_task_mgmt_timeout = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.header_digest = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.data_digest = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.immediate_data = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.initial_r2t = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.data_seq_inorder = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.data_pdu_inorder = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.erl = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.max_receive_data_len = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.first_burst_len = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.max_outstanding_r2t = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.max_burst_len = 0
Nov 28 06:51:49 user nova-compute[74870]: iface.chap_auth = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.bidi_chap = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.strict_login_compliance = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.discovery_auth = <empty>
Nov 28 06:51:49 user nova-compute[74870]: iface.discovery_logout = <empty>
Nov 28 06:51:49 user nova-compute[74870]: node.discovery_address = <empty>
Nov 28 06:51:49 user nova-compute[74870]: node.discovery_port = 0
Nov 28 06:51:49 user nova-compute[74870]: node.discovery_type = static
Nov 28 06:51:49 user nova-compute[74870]: node.session.initial_cmdsn = 0
Nov 28 06:51:49 user nova-compute[74870]: node.session.initial_login_retry_max = 8
Nov 28 06:51:49 user nova-compute[74870]: node.session.xmit_thread_priority = -20
Nov 28 06:51:49 user nova-compute[74870]: node.session.cmds_max = 128
Nov 28 06:51:49 user nova-compute[74870]: node.session.queue_depth = 32
Nov 28 06:51:49 user nova-compute[74870]: node.session.nr_sessions = 1
Nov 28 06:51:49 user nova-compute[74870]: node.session.auth.authmethod = CHAP
Nov 28 06:51:49 user nova-compute[74870]: node.session.auth.username = WPNUvdgX
Nov 28 06:51:49 user nova-compute[74870]: node.session.auth.password = ***
Nov 28 06:51:49 user nova-compute[74870]: node.session.auth.username_in = <empty>
Nov 28 06:51:49 user nova-compute[74870]: node.session.auth.password_in = <empty>
Nov 28 06:51:49 user nova-compute[74870]: node.session.auth.chap_algs = MD5
Nov 28 06:51:49 user nova-compute[74870]: node.session.timeo.replacement_timeout = 120
Nov 28 06:51:49 user nova-compute[74870]: node.session.err_timeo.abort_timeout = 15
Nov 28 06:51:49 user nova-compute[74870]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 06:51:49 user nova-compute[74870]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 06:51:49 user nova-compute[74870]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.FastAbort = Yes
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.InitialR2T = No
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.ImmediateData = Yes
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.MaxConnections = 1
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 06:51:49 user nova-compute[74870]: node.session.iscsi.ERL = 0
Nov 28 06:51:49 user nova-compute[74870]: node.session.scan = manual
Nov 28 06:51:49 user nova-compute[74870]: node.session.reopen_max = 0
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].address = 172.16.0.220
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].port = 3260
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].startup = manual
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].tcp.window_size = 524288
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].tcp.type_of_service = 0
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].timeo.logout_timeout = 15
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].timeo.login_timeout = 15
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].timeo.auth_timeout = 45
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].iscsi.DataDigest = None
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].iscsi.IFMarker = No
Nov 28 06:51:49 user nova-compute[74870]: node.conn[0].iscsi.OFMarker = No
Nov 28 06:51:49 user nova-compute[74870]: # END RECORD
Nov 28 06:51:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[410436fe-9013-45fe-9d9c-43a651819c42]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dbd0b1-440d-45bd-b59f-10875fecd62d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPNUvdgX {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPNUvdgX" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6523d30b-f6f1-4dcd-b7ba-347c3913fdcf]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPNUvdgX'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[de89305f-d6c1-400d-810f-a90f39a17735]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[635da509-8b98-49e5-945c-2a3afd3ddf0d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:49 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:49 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:49 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:51:49 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:51:49 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:51:49 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:51:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HCTL ('34', '0', '0', 0) found on session 34 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6c4b30-2d4f-43d2-a828-7f91fe94cc1d]: (4, ('0 0 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Searching for a device in session 34 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23936313966363064', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936313966363064', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1304545091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1304545091',id=32,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-yej7ft2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:50:16Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=3a328017-e6a2-4b35-a18d-d51a14e29895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "vif_mac": "fa:16:3e:f3:c9:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "vif_mac": "fa:16:3e:f3:c9:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.objects.base [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Object Instance<3a328017-e6a2-4b35-a18d-d51a14e29895> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:51:49 user nova-compute[74870]:   <uuid>3a328017-e6a2-4b35-a18d-d51a14e29895</uuid>
Nov 28 06:51:49 user nova-compute[74870]:   <name>instance-00000020</name>
Nov 28 06:51:49 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:51:49 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:51:49 user nova-compute[74870]:   <metadata>
Nov 28 06:51:49 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:51:49 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:51:49 user nova-compute[74870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1304545091</nova:name>
Nov 28 06:51:49 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:51:48</nova:creationTime>
Nov 28 06:51:49 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:51:49 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:51:49 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:51:49 user nova-compute[74870]:       <nova:owner>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:user uuid="c13b793a926942e88fc3416cf3fa005e">tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member</nova:user>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:project uuid="a07e9312175c4e73aa29a51865d61ebd">tempest-ServerBootFromVolumeStableRescueTest-397751332</nova:project>
Nov 28 06:51:49 user nova-compute[74870]:       </nova:owner>
Nov 28 06:51:49 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:51:49 user nova-compute[74870]:       <nova:ports>
Nov 28 06:51:49 user nova-compute[74870]:         <nova:port uuid="afd5f93d-f360-467a-9e4c-b7816bcd41ae">
Nov 28 06:51:49 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:51:49 user nova-compute[74870]:         </nova:port>
Nov 28 06:51:49 user nova-compute[74870]:       </nova:ports>
Nov 28 06:51:49 user nova-compute[74870]:     </nova:instance>
Nov 28 06:51:49 user nova-compute[74870]:   </metadata>
Nov 28 06:51:49 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:51:49 user nova-compute[74870]:     <system>
Nov 28 06:51:49 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:51:49 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:51:49 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:51:49 user nova-compute[74870]:       <entry name="serial">3a328017-e6a2-4b35-a18d-d51a14e29895</entry>
Nov 28 06:51:49 user nova-compute[74870]:       <entry name="uuid">3a328017-e6a2-4b35-a18d-d51a14e29895</entry>
Nov 28 06:51:49 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:51:49 user nova-compute[74870]:     </system>
Nov 28 06:51:49 user nova-compute[74870]:   </sysinfo>
Nov 28 06:51:49 user nova-compute[74870]:   <os>
Nov 28 06:51:49 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:51:49 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:51:49 user nova-compute[74870]:   </os>
Nov 28 06:51:49 user nova-compute[74870]:   <features>
Nov 28 06:51:49 user nova-compute[74870]:     <acpi/>
Nov 28 06:51:49 user nova-compute[74870]:     <apic/>
Nov 28 06:51:49 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:51:49 user nova-compute[74870]:   </features>
Nov 28 06:51:49 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:51:49 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:51:49 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:51:49 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:51:49 user nova-compute[74870]:   </clock>
Nov 28 06:51:49 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:51:49 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:51:49 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:51:49 user nova-compute[74870]:   </cpu>
Nov 28 06:51:49 user nova-compute[74870]:   <devices>
Nov 28 06:51:49 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:51:49 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:49 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:51:49 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:51:49 user nova-compute[74870]:       <serial>d49686c2-d776-448d-ad9b-8e0fc72e9d2b</serial>
Nov 28 06:51:49 user nova-compute[74870]:     </disk>
Nov 28 06:51:49 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:51:49 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:51:49 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue"/>
Nov 28 06:51:49 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 06:51:49 user nova-compute[74870]:       <boot order="1"/>
Nov 28 06:51:49 user nova-compute[74870]:     </disk>
Nov 28 06:51:49 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:51:49 user nova-compute[74870]:       <mac address="fa:16:3e:f3:c9:07"/>
Nov 28 06:51:49 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:51:49 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:51:49 user nova-compute[74870]:       <target dev="tapafd5f93d-f3"/>
Nov 28 06:51:49 user nova-compute[74870]:     </interface>
Nov 28 06:51:49 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:51:49 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/console.log" append="off"/>
Nov 28 06:51:49 user nova-compute[74870]:     </serial>
Nov 28 06:51:49 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:51:49 user nova-compute[74870]:     <video>
Nov 28 06:51:49 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:51:49 user nova-compute[74870]:     </video>
Nov 28 06:51:49 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:51:49 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:51:49 user nova-compute[74870]:     </rng>
Nov 28 06:51:49 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:51:49 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:51:49 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:51:49 user nova-compute[74870]:     </memballoon>
Nov 28 06:51:49 user nova-compute[74870]:   </devices>
Nov 28 06:51:49 user nova-compute[74870]: </domain>
Nov 28 06:51:49 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:51:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance destroyed successfully.
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] No VIF found with MAC fa:16:3e:f3:c9:07, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance destroyed successfully.
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:51:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Instance destroyed successfully.
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'resources' on Instance uuid c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1101632916',display_name='tempest-AttachVolumeNegativeTest-server-1101632916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1101632916',id=31,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ9uweIxjBCanmmT+01e+MV5bbT1foqRxFeoxQiitX1GY9EPkJhtQPbVJG1tw3les1DVgMZDuDWvExHqyXpGGDwn9KjzAwnApDu7CqUAGqzvyLltupdS+va65XaMVonDQ==',key_name='tempest-keypair-923733588',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5df9ec769206481e8dad48a6461c46ba',ramdisk_id='',reservation_id='r-oef3okgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-538884229',owner_user_name='tempest-AttachVolumeNegativeTest-538884229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e396090c4b4a8995d8d2e66c8b3db0',uuid=c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converting VIF {"id": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "address": "fa:16:3e:02:0a:ef", "network": {"id": "202f7756-ce64-4307-8a6b-b7601305e6b7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1909878448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9ec769206481e8dad48a6461c46ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c5e041-ed", "ovs_interfaceid": "b7c5e041-ed7b-4c47-96b6-dbebd8356786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG os_vif [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c5e041-ed, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.233s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de6b6c8e-2bb4-4247-8c35-0898c4e82a03) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:49 user nova-compute[74870]: INFO os_vif [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=b7c5e041-ed7b-4c47-96b6-dbebd8356786,network=Network(202f7756-ce64-4307-8a6b-b7601305e6b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c5e041-ed')
Nov 28 06:51:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Deleting instance files /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db_del
Nov 28 06:51:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Deletion of /opt/stack/data/nova/instances/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db_del complete
Nov 28 06:51:49 user nova-compute[74870]: INFO nova.compute.manager [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 28 06:51:49 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:51:49 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:50 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Took 0.76 seconds to deallocate network for instance.
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:50 user nova-compute[74870]: WARNING nova.compute.manager [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state stopped and task_state None.
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-vif-deleted-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received event network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Acquiring lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] No waiting events found dispatching network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:50 user nova-compute[74870]: WARNING nova.compute.manager [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Received unexpected event network-vif-plugged-b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance with vm_state deleted and task_state None.
Nov 28 06:51:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:50 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Deleted allocations for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db
Nov 28 06:51:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.614s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:51 user nova-compute[74870]: WARNING nova.compute.manager [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state rescuing.
Nov 28 06:51:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:52 user nova-compute[74870]: INFO nova.compute.manager [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Terminating instance
Nov 28 06:51:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:51:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:53 user nova-compute[74870]: WARNING nova.compute.manager [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state rescuing.
Nov 28 06:51:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:51:53 user nova-compute[74870]: INFO nova.compute.manager [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Detaching volume 099bd1dc-45f7-4f2f-9e1f-f47124112712
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-vif-unplugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] No waiting events found dispatching network-vif-unplugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-vif-unplugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:51:53 user nova-compute[74870]: INFO nova.virt.block_device [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Attempting to driver detach volume 099bd1dc-45f7-4f2f-9e1f-f47124112712 from mountpoint /dev/vdb
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Attempting to detach device vdb from instance ab422771-7c11-4074-b4a6-d793c790e813 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:53 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:53 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:51:53 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:51:53 user nova-compute[74870]:   <serial>099bd1dc-45f7-4f2f-9e1f-f47124112712</serial>
Nov 28 06:51:53 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:51:53 user nova-compute[74870]: </disk>
Nov 28 06:51:53 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Successfully detached device vdb from instance ab422771-7c11-4074-b4a6-d793c790e813 from the persistent domain config.
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab422771-7c11-4074-b4a6-d793c790e813 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:51:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:51:53 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:51:53 user nova-compute[74870]:   <source dev="/dev/sde"/>
Nov 28 06:51:53 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:51:53 user nova-compute[74870]:   <serial>099bd1dc-45f7-4f2f-9e1f-f47124112712</serial>
Nov 28 06:51:53 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:51:53 user nova-compute[74870]: </disk>
Nov 28 06:51:53 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:51:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Instance destroyed successfully.
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lazy-loading 'resources' on Instance uuid f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1539515390',display_name='tempest-VolumesActionsTest-instance-1539515390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1539515390',id=33,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4386d41a22343b185f320b3f90d1a83',ramdisk_id='',reservation_id='r-n45129z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1371009149',owner_user_name='tempest-VolumesActionsTest-1371009149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:50:09Z,user_data=None,user_id='9a2c63a8fe9f4992b7ff2aa75a6c4b86',uuid=f69fbbd9-cf47-4ef8-8a60-848ee895a8e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converting VIF {"id": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "address": "fa:16:3e:bb:f3:5e", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap632eb6d0-16", "ovs_interfaceid": "632eb6d0-1687-4fac-a60d-f919d2ea0941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG os_vif [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap632eb6d0-16, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab181fca-45f0-4964-ab97-d2b81a90773a) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:54 user nova-compute[74870]: INFO os_vif [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:5e,bridge_name='br-int',has_traffic_filtering=True,id=632eb6d0-1687-4fac-a60d-f919d2ea0941,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap632eb6d0-16')
Nov 28 06:51:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Deleting instance files /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6_del
Nov 28 06:51:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Deletion of /opt/stack/data/nova/instances/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6_del complete
Nov 28 06:51:54 user nova-compute[74870]: INFO nova.compute.manager [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 28 06:51:54 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-vif-deleted-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:54 user nova-compute[74870]: INFO nova.compute.manager [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Neutron deleted interface 632eb6d0-1687-4fac-a60d-f919d2ea0941; detaching it from the instance and deleting it from the info cache
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.network.neutron [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:51:54 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Took 0.52 seconds to deallocate network for instance.
Nov 28 06:51:54 user nova-compute[74870]: DEBUG nova.compute.manager [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Detach interface failed, port_id=632eb6d0-1687-4fac-a60d-f919d2ea0941, reason: Instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:55 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Deleted allocations for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6
Nov 28 06:51:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received event network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Acquiring lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Lock "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:51:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] No waiting events found dispatching network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:51:55 user nova-compute[74870]: WARNING nova.compute.manager [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Received unexpected event network-vif-plugged-632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance with vm_state deleted and task_state None.
Nov 28 06:51:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:51:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:13 user nova-compute[74870]: INFO nova.compute.manager [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Terminating instance
Nov 28 06:52:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ab422771-7c11-4074-b4a6-d793c790e813 is timed out.
Nov 28 06:52:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Successfully detached device vdb from instance ab422771-7c11-4074-b4a6-d793c790e813 from the live domain config.
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znsjPkSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:52:14 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c935712-661a-4b94-ad79-b606e3667b1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:52:14 user nova-compute[74870]: No targets found.
Nov 28 06:52:14 user nova-compute[74870]: iSNS:
Nov 28 06:52:14 user nova-compute[74870]: No targets found.
Nov 28 06:52:14 user nova-compute[74870]: STATIC:
Nov 28 06:52:14 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712
Nov 28 06:52:14 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:52:14 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:52:14 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:52:14 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:52:14 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:52:14 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:52:14 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:52:14 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:52:14 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:52:14 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:52:14 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:52:14 user nova-compute[74870]: FIRMWARE:
Nov 28 06:52:14 user nova-compute[74870]: No targets found.
Nov 28 06:52:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:52:14 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:52:14 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e2525f-330c-4c47-a9f5-dbe44c4523c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a8e1bb-f015-4bb3-8d1f-97798e6b4d4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:52:14 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:52:14 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:52:14 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:52:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:52:14 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:52:14 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:52:14 user nova-compute[74870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 (non-flash)
Nov 28 06:52:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc5a5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712'): ({'sde'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Removing single pathed devices sde {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-unplugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-unplugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-unplugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051fbba-369c-4ad0-ad48-5d258182a121]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6324ee57-0c82-447a-928d-7c36285b5bff]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Flushing IO for device /dev/sde {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eed0d0-898a-4b8d-8420-beed97d281dd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b77e461-8332-4695-9f13-f674ad7ef02b]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17913bb6-467a-451d-8b95-0dd7f4369e0c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[38180405-abb0-4e0b-8395-f265c48fcdcf]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260]
Nov 28 06:52:14 user nova-compute[74870]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712, portal: 172.16.0.220,3260] successful.
Nov 28 06:52:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:099bd1dc-45f7-4f2f-9e1f-f47124112712 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6df519-6335-4cb5-a885-b3eeca1d47e7]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] <== disconnect_volume: return (333ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:52:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Instance destroyed successfully.
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'resources' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-865386610',display_name='tempest-ServerActionsTestOtherA-server-512573953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-865386610',id=25,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ==',key_name='tempest-keypair-940347240',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-0n77xil0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=30c7dc1e-9569-49f5-aabf-a98cba6470fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "address": "fa:16:3e:a8:ad:04", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6dbf47-12", "ovs_interfaceid": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG os_vif [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a6dbf47-12, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e06e4059-2b9e-4b3a-96d7-3e74aad1b2dc) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:14 user nova-compute[74870]: INFO os_vif [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=5a6dbf47-1250-4f02-87b4-6d33d64d34eb,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6dbf47-12')
Nov 28 06:52:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Deleting instance files /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa_del
Nov 28 06:52:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Deletion of /opt/stack/data/nova/instances/30c7dc1e-9569-49f5-aabf-a98cba6470fa_del complete
Nov 28 06:52:14 user nova-compute[74870]: INFO nova.compute.manager [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 06:52:14 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:52:14 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:52:15 user nova-compute[74870]: DEBUG nova.objects.instance [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'flavor' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:52:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.976s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:15 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:15 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Took 0.76 seconds to deallocate network for instance.
Nov 28 06:52:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:16 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Deleted allocations for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa
Nov 28 06:52:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.223s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Acquiring lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Lock "30c7dc1e-9569-49f5-aabf-a98cba6470fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] No waiting events found dispatching network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:52:16 user nova-compute[74870]: WARNING nova.compute.manager [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received unexpected event network-vif-plugged-5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance with vm_state deleted and task_state None.
Nov 28 06:52:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Received event network-vif-deleted-5a6dbf47-1250-4f02-87b4-6d33d64d34eb {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:19 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:52:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:52:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=25.10820770263672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance ab422771-7c11-4074-b4a6-d793c790e813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:52:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:52:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:52:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:52:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:52:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:52:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:52:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:52:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing instance network info cache due to event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:52:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:52:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:52:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updated VIF entry in instance network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:42 user nova-compute[74870]: INFO nova.compute.manager [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Detaching volume daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:52:42 user nova-compute[74870]: INFO nova.virt.block_device [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Attempting to driver detach volume daa2eb88-295a-4c93-81a0-3f799e732e97 from mountpoint /dev/vdb
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Attempting to detach device vdb from instance de112cbb-849e-43c1-961a-4457585f2e9a from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:52:42 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:52:42 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:52:42 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:52:42 user nova-compute[74870]:   <serial>daa2eb88-295a-4c93-81a0-3f799e732e97</serial>
Nov 28 06:52:42 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:52:42 user nova-compute[74870]: </disk>
Nov 28 06:52:42 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:52:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully detached device vdb from instance de112cbb-849e-43c1-961a-4457585f2e9a from the persistent domain config.
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de112cbb-849e-43c1-961a-4457585f2e9a from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:52:42 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:52:42 user nova-compute[74870]:   <source dev="/dev/sdg"/>
Nov 28 06:52:42 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:52:42 user nova-compute[74870]:   <serial>daa2eb88-295a-4c93-81a0-3f799e732e97</serial>
Nov 28 06:52:42 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:52:42 user nova-compute[74870]: </disk>
Nov 28 06:52:42 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:52:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing instance network info cache due to event network-changed-05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG nova.network.neutron [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Refreshing network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:43 user nova-compute[74870]: INFO nova.compute.manager [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Terminating instance
Nov 28 06:52:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.network.neutron [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updated VIF entry in instance network info cache for port 05ecf301-f2f8-4953-997c-6855e4f27db7. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.network.neutron [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:52:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Instance destroyed successfully.
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'resources' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-368773156',display_name='tempest-TestServerVolumeAttachmentScenario-server-368773156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-368773156',id=30,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODxKF/OFbZznyIWUBEYrF6APCNw+niqepzasaoANx1P3W6SKf9cpMx/jUf/m5UakKfcm2/aZgHCrOgNhmzzwVVzs4/c9tpFTJFkpBpSq6wrMu+eS98BH7Ve1fQI0zJUKQ==',key_name='tempest-keypair-1581719119',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55617103c9e348b3bc963810362acb6b',ramdisk_id='',reservation_id='r-70051wuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-406971450',owner_user_name='tempest-TestServerVolumeAttachmentScenario-406971450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1b878f5054743d690f01e77e7425371',uuid=ab422771-7c11-4074-b4a6-d793c790e813,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Converting VIF {"id": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "address": "fa:16:3e:3a:66:42", "network": {"id": "21375faf-748b-4eae-8d27-6e8a507aa6cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224472419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55617103c9e348b3bc963810362acb6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dce38d6-cf", "ovs_interfaceid": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG os_vif [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dce38d6-cf, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=213f76f6-83aa-4306-82c1-d39ca2a69ce1) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:44 user nova-compute[74870]: INFO os_vif [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:66:42,bridge_name='br-int',has_traffic_filtering=True,id=5dce38d6-cf1d-4a63-a798-fa9bc36f7418,network=Network(21375faf-748b-4eae-8d27-6e8a507aa6cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dce38d6-cf')
Nov 28 06:52:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Deleting instance files /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813_del
Nov 28 06:52:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Deletion of /opt/stack/data/nova/instances/ab422771-7c11-4074-b4a6-d793c790e813_del complete
Nov 28 06:52:44 user nova-compute[74870]: INFO nova.compute.manager [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 28 06:52:44 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: ab422771-7c11-4074-b4a6-d793c790e813] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:52:45 user nova-compute[74870]: INFO nova.compute.claims [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Claim successful on node user
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:52:45 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Took 0.75 seconds to deallocate network for instance.
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-vif-unplugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] No waiting events found dispatching network-vif-unplugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-vif-unplugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Acquiring lock "ab422771-7c11-4074-b4a6-d793c790e813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Lock "ab422771-7c11-4074-b4a6-d793c790e813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] No waiting events found dispatching network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:52:45 user nova-compute[74870]: WARNING nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received unexpected event network-vif-plugged-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance with vm_state active and task_state deleting.
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Received event network-vif-deleted-5dce38d6-cf1d-4a63-a798-fa9bc36f7418 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.policy [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:52:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Creating image(s)
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "/opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "/opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk 1073741824" returned: 0 in 0.061s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.676s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:46 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Deleted allocations for instance ab422771-7c11-4074-b4a6-d793c790e813
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Successfully created port: 64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "ab422771-7c11-4074-b4a6-d793c790e813" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.660s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.200s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Cannot resize image /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Ensure instance console log exists: /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Successfully updated port: 64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "refresh_cache-9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquired lock "refresh_cache-9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Updating instance_info_cache with network_info: [{"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Releasing lock "refresh_cache-9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Instance network_info: |[{"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Start _get_guest_xml network_info=[{"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:52:47 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:52:47 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-520150813',display_name='tempest-VolumesActionsTest-instance-520150813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-520150813',id=35,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4386d41a22343b185f320b3f90d1a83',ramdisk_id='',reservation_id='r-x5ctpn04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1371009149',owner_user_name='tempest-VolumesActionsTest-1371009149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:52:46Z,user_data=None,user_id='9a2c63a8fe9f4992b7ff2aa75a6c4b86',uuid=9a9822ce-81f4-4988-a8c7-d65aa3d7dec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converting VIF {"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.objects.instance [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:52:47 user nova-compute[74870]:   <uuid>9a9822ce-81f4-4988-a8c7-d65aa3d7dec7</uuid>
Nov 28 06:52:47 user nova-compute[74870]:   <name>instance-00000023</name>
Nov 28 06:52:47 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:52:47 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:52:47 user nova-compute[74870]:   <metadata>
Nov 28 06:52:47 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:52:47 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:52:47 user nova-compute[74870]:       <nova:name>tempest-VolumesActionsTest-instance-520150813</nova:name>
Nov 28 06:52:47 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:52:47</nova:creationTime>
Nov 28 06:52:47 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:52:47 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:52:47 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:52:47 user nova-compute[74870]:       <nova:owner>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:user uuid="9a2c63a8fe9f4992b7ff2aa75a6c4b86">tempest-VolumesActionsTest-1371009149-project-member</nova:user>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:project uuid="d4386d41a22343b185f320b3f90d1a83">tempest-VolumesActionsTest-1371009149</nova:project>
Nov 28 06:52:47 user nova-compute[74870]:       </nova:owner>
Nov 28 06:52:47 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:52:47 user nova-compute[74870]:       <nova:ports>
Nov 28 06:52:47 user nova-compute[74870]:         <nova:port uuid="64772336-969e-475c-8f13-e208982f0df3">
Nov 28 06:52:47 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 06:52:47 user nova-compute[74870]:         </nova:port>
Nov 28 06:52:47 user nova-compute[74870]:       </nova:ports>
Nov 28 06:52:47 user nova-compute[74870]:     </nova:instance>
Nov 28 06:52:47 user nova-compute[74870]:   </metadata>
Nov 28 06:52:47 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:52:47 user nova-compute[74870]:     <system>
Nov 28 06:52:47 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:52:47 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:52:47 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:52:47 user nova-compute[74870]:       <entry name="serial">9a9822ce-81f4-4988-a8c7-d65aa3d7dec7</entry>
Nov 28 06:52:47 user nova-compute[74870]:       <entry name="uuid">9a9822ce-81f4-4988-a8c7-d65aa3d7dec7</entry>
Nov 28 06:52:47 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:52:47 user nova-compute[74870]:     </system>
Nov 28 06:52:47 user nova-compute[74870]:   </sysinfo>
Nov 28 06:52:47 user nova-compute[74870]:   <os>
Nov 28 06:52:47 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:52:47 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:52:47 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:52:47 user nova-compute[74870]:   </os>
Nov 28 06:52:47 user nova-compute[74870]:   <features>
Nov 28 06:52:47 user nova-compute[74870]:     <acpi/>
Nov 28 06:52:47 user nova-compute[74870]:     <apic/>
Nov 28 06:52:47 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:52:47 user nova-compute[74870]:   </features>
Nov 28 06:52:47 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:52:47 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:52:47 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:52:47 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:52:47 user nova-compute[74870]:   </clock>
Nov 28 06:52:47 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:52:47 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:52:47 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:52:47 user nova-compute[74870]:   </cpu>
Nov 28 06:52:47 user nova-compute[74870]:   <devices>
Nov 28 06:52:47 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:52:47 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:52:47 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk"/>
Nov 28 06:52:47 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:52:47 user nova-compute[74870]:     </disk>
Nov 28 06:52:47 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:52:47 user nova-compute[74870]:       <mac address="fa:16:3e:bd:71:cd"/>
Nov 28 06:52:47 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:52:47 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:52:47 user nova-compute[74870]:       <target dev="tap64772336-96"/>
Nov 28 06:52:47 user nova-compute[74870]:     </interface>
Nov 28 06:52:47 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:52:47 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/console.log" append="off"/>
Nov 28 06:52:47 user nova-compute[74870]:     </serial>
Nov 28 06:52:47 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:52:47 user nova-compute[74870]:     <video>
Nov 28 06:52:47 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:52:47 user nova-compute[74870]:     </video>
Nov 28 06:52:47 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:52:47 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:52:47 user nova-compute[74870]:     </rng>
Nov 28 06:52:47 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:52:47 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:52:47 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:52:47 user nova-compute[74870]:     </memballoon>
Nov 28 06:52:47 user nova-compute[74870]:   </devices>
Nov 28 06:52:47 user nova-compute[74870]: </domain>
Nov 28 06:52:47 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-520150813',display_name='tempest-VolumesActionsTest-instance-520150813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-520150813',id=35,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4386d41a22343b185f320b3f90d1a83',ramdisk_id='',reservation_id='r-x5ctpn04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1371009149',owner_user_name='tempest-VolumesActionsTest-1371009149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:52:46Z,user_data=None,user_id='9a2c63a8fe9f4992b7ff2aa75a6c4b86',uuid=9a9822ce-81f4-4988-a8c7-d65aa3d7dec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converting VIF {"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG os_vif [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38f325fc-a870-5c12-b74d-6a9eea31500e', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64772336-96, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64772336-96, col_values=(('qos', UUID('bb8af4e7-a48d-45c2-8e57-3d12ef7464fb')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64772336-96, col_values=(('external_ids', {'iface-id': '64772336-969e-475c-8f13-e208982f0df3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:71:cd', 'vm-uuid': '9a9822ce-81f4-4988-a8c7-d65aa3d7dec7'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-changed-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Refreshing instance network info cache due to event network-changed-64772336-969e-475c-8f13-e208982f0df3. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Acquiring lock "refresh_cache-9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Acquired lock "refresh_cache-9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.network.neutron [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Refreshing network info cache for port 64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:47 user nova-compute[74870]: INFO os_vif [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96')
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:52:47 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] No VIF found with MAC fa:16:3e:bd:71:cd, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:52:48 user nova-compute[74870]: DEBUG nova.network.neutron [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Updated VIF entry in instance network info cache for port 64772336-969e-475c-8f13-e208982f0df3. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:52:48 user nova-compute[74870]: DEBUG nova.network.neutron [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Updating instance_info_cache with network_info: [{"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:52:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Releasing lock "refresh_cache-9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] No waiting events found dispatching network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:52:49 user nova-compute[74870]: WARNING nova.compute.manager [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received unexpected event network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 for instance with vm_state building and task_state spawning.
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] No waiting events found dispatching network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:52:51 user nova-compute[74870]: WARNING nova.compute.manager [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received unexpected event network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 for instance with vm_state building and task_state spawning.
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:52:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Instance spawned successfully.
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:52:51 user nova-compute[74870]: INFO nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 28 06:52:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:52:51 user nova-compute[74870]: INFO nova.compute.manager [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Took 6.79 seconds to build instance.
Nov 28 06:52:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.941s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:52:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:52:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:02 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de112cbb-849e-43c1-961a-4457585f2e9a is timed out.
Nov 28 06:53:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully detached device vdb from instance de112cbb-849e-43c1-961a-4457585f2e9a from the live domain config.
Nov 28 06:53:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crEZRBCy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:53:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e42db-35dd-487a-8910-d6fa3b14d0c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef1adc00-8b68-4ccd-83d4-750a8cd6ae4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbb2adf7-8179-41a3-9d6f-50eb6acb9c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:53:02 user nova-compute[74870]: No targets found.
Nov 28 06:53:02 user nova-compute[74870]: iSNS:
Nov 28 06:53:02 user nova-compute[74870]: No targets found.
Nov 28 06:53:02 user nova-compute[74870]: STATIC:
Nov 28 06:53:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ef1adc00-8b68-4ccd-83d4-750a8cd6ae4c
Nov 28 06:53:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:53:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:53:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cbb2adf7-8179-41a3-9d6f-50eb6acb9c71
Nov 28 06:53:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:53:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:53:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:53:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:53:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:53:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:53:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:53:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:53:02 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97
Nov 28 06:53:02 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:53:02 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:53:02 user nova-compute[74870]: FIRMWARE:
Nov 28 06:53:02 user nova-compute[74870]: No targets found.
Nov 28 06:53:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:53:02 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:53:02 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91916d1-475e-4177-9ecd-6f99f05b1f0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbb2adf7-8179-41a3-9d6f-50eb6acb9c71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef1adc00-8b68-4ccd-83d4-750a8cd6ae4c\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c60962-89df-4fe6-b3f9-119f43956845]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1adc00-8b68-4ccd-83d4-750a8cd6ae4c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb2adf7-8179-41a3-9d6f-50eb6acb9c71 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1adc00-8b68-4ccd-83d4-750a8cd6ae4c (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb2adf7-8179-41a3-9d6f-50eb6acb9c71 (non-flash)
Nov 28 06:53:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef1adc00-8b68-4ccd-83d4-750a8cd6ae4c (non-flash)
Nov 28 06:53:02 user nova-compute[74870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb2adf7-8179-41a3-9d6f-50eb6acb9c71 (non-flash)
Nov 28 06:53:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc5a6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97'): ({'sdg'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Removing single pathed devices sdg {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8b6dd-65ec-4fe1-ab51-1808c66ed8ec]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa65ff03-4981-47a4-800c-e92e3c89e611]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flushing IO for device /dev/sdg {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9c582-0abf-4ce5-b53f-9442158d5754]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:53:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.070s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c918419-0681-4b30-8672-e28832d1ab5c]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] SCSI volumes sdg have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8065767a-c07b-442e-864a-08f787c3bb4f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced69c6d-0f01-4c99-9c31-ab74cdd9b345]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260]
Nov 28 06:53:03 user nova-compute[74870]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97, portal: 172.16.0.220,3260] successful.
Nov 28 06:53:03 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa2eb88-295a-4c93-81a0-3f799e732e97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cbd37e-49fd-4a4d-9224-2f5bc79ee948]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] <== disconnect_volume: return (379ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:53:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:53:04 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.916s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-changed-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing instance network info cache due to event network-changed-fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:53:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:18 user nova-compute[74870]: DEBUG nova.network.neutron [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing network info cache for port fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updated VIF entry in instance network info cache for port fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG nova.network.neutron [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "d29505be-335a-4f7c-908c-324750c31205" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:20 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:53:20 user nova-compute[74870]: INFO nova.compute.claims [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Claim successful on node user
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.253s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:53:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.policy [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62687690bcc64588ab57d9ca8b6ea5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f780d5cb4154beb808bf1232426586b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:53:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Creating image(s)
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "/opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "/opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "/opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk 1073741824" returned: 0 in 0.056s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Successfully created port: 9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Cannot resize image /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Ensure instance console log exists: /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:22 user nova-compute[74870]: INFO nova.compute.manager [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Shelving
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Successfully updated port: 9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "refresh_cache-d29505be-335a-4f7c-908c-324750c31205" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquired lock "refresh_cache-d29505be-335a-4f7c-908c-324750c31205" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-changed-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Refreshing instance network info cache due to event network-changed-9beb1c6e-fc84-48f9-948e-aead3886696b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Acquiring lock "refresh_cache-d29505be-335a-4f7c-908c-324750c31205" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Updating instance_info_cache with network_info: [{"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Releasing lock "refresh_cache-d29505be-335a-4f7c-908c-324750c31205" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Instance network_info: |[{"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Acquired lock "refresh_cache-d29505be-335a-4f7c-908c-324750c31205" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Refreshing network info cache for port 9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Start _get_guest_xml network_info=[{"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:53:23 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:53:23 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1227503680',display_name='tempest-VolumesActionsTest-instance-1227503680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1227503680',id=36,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f780d5cb4154beb808bf1232426586b',ramdisk_id='',reservation_id='r-8qf5iq3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1817915228',owner_user_name='tempest-VolumesActionsTest-1817915228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:53:21Z,user_data=None,user_id='62687690bcc64588ab57d9ca8b6ea5ec',uuid=d29505be-335a-4f7c-908c-324750c31205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Converting VIF {"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lazy-loading 'pci_devices' on Instance uuid d29505be-335a-4f7c-908c-324750c31205 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:53:23 user nova-compute[74870]:   <uuid>d29505be-335a-4f7c-908c-324750c31205</uuid>
Nov 28 06:53:23 user nova-compute[74870]:   <name>instance-00000024</name>
Nov 28 06:53:23 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:53:23 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:53:23 user nova-compute[74870]:   <metadata>
Nov 28 06:53:23 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:53:23 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:53:23 user nova-compute[74870]:       <nova:name>tempest-VolumesActionsTest-instance-1227503680</nova:name>
Nov 28 06:53:23 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:53:23</nova:creationTime>
Nov 28 06:53:23 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:53:23 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:53:23 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:53:23 user nova-compute[74870]:       <nova:owner>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:user uuid="62687690bcc64588ab57d9ca8b6ea5ec">tempest-VolumesActionsTest-1817915228-project-member</nova:user>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:project uuid="5f780d5cb4154beb808bf1232426586b">tempest-VolumesActionsTest-1817915228</nova:project>
Nov 28 06:53:23 user nova-compute[74870]:       </nova:owner>
Nov 28 06:53:23 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:53:23 user nova-compute[74870]:       <nova:ports>
Nov 28 06:53:23 user nova-compute[74870]:         <nova:port uuid="9beb1c6e-fc84-48f9-948e-aead3886696b">
Nov 28 06:53:23 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 06:53:23 user nova-compute[74870]:         </nova:port>
Nov 28 06:53:23 user nova-compute[74870]:       </nova:ports>
Nov 28 06:53:23 user nova-compute[74870]:     </nova:instance>
Nov 28 06:53:23 user nova-compute[74870]:   </metadata>
Nov 28 06:53:23 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:53:23 user nova-compute[74870]:     <system>
Nov 28 06:53:23 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:53:23 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:53:23 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:53:23 user nova-compute[74870]:       <entry name="serial">d29505be-335a-4f7c-908c-324750c31205</entry>
Nov 28 06:53:23 user nova-compute[74870]:       <entry name="uuid">d29505be-335a-4f7c-908c-324750c31205</entry>
Nov 28 06:53:23 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:53:23 user nova-compute[74870]:     </system>
Nov 28 06:53:23 user nova-compute[74870]:   </sysinfo>
Nov 28 06:53:23 user nova-compute[74870]:   <os>
Nov 28 06:53:23 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:53:23 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:53:23 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:53:23 user nova-compute[74870]:   </os>
Nov 28 06:53:23 user nova-compute[74870]:   <features>
Nov 28 06:53:23 user nova-compute[74870]:     <acpi/>
Nov 28 06:53:23 user nova-compute[74870]:     <apic/>
Nov 28 06:53:23 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:53:23 user nova-compute[74870]:   </features>
Nov 28 06:53:23 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:53:23 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:53:23 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:53:23 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:53:23 user nova-compute[74870]:   </clock>
Nov 28 06:53:23 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:53:23 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:53:23 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:53:23 user nova-compute[74870]:   </cpu>
Nov 28 06:53:23 user nova-compute[74870]:   <devices>
Nov 28 06:53:23 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:53:23 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:53:23 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk"/>
Nov 28 06:53:23 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:53:23 user nova-compute[74870]:     </disk>
Nov 28 06:53:23 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:53:23 user nova-compute[74870]:       <mac address="fa:16:3e:dd:6c:e4"/>
Nov 28 06:53:23 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:53:23 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:53:23 user nova-compute[74870]:       <target dev="tap9beb1c6e-fc"/>
Nov 28 06:53:23 user nova-compute[74870]:     </interface>
Nov 28 06:53:23 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:53:23 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/console.log" append="off"/>
Nov 28 06:53:23 user nova-compute[74870]:     </serial>
Nov 28 06:53:23 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:53:23 user nova-compute[74870]:     <video>
Nov 28 06:53:23 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:53:23 user nova-compute[74870]:     </video>
Nov 28 06:53:23 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:53:23 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:53:23 user nova-compute[74870]:     </rng>
Nov 28 06:53:23 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:53:23 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:53:23 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:53:23 user nova-compute[74870]:     </memballoon>
Nov 28 06:53:23 user nova-compute[74870]:   </devices>
Nov 28 06:53:23 user nova-compute[74870]: </domain>
Nov 28 06:53:23 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1227503680',display_name='tempest-VolumesActionsTest-instance-1227503680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1227503680',id=36,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f780d5cb4154beb808bf1232426586b',ramdisk_id='',reservation_id='r-8qf5iq3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1817915228',owner_user_name='tempest-VolumesActionsTest-1817915228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:53:21Z,user_data=None,user_id='62687690bcc64588ab57d9ca8b6ea5ec',uuid=d29505be-335a-4f7c-908c-324750c31205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Converting VIF {"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG os_vif [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00fba303-30ae-5191-b4cd-c49ab310b8e8', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance destroyed successfully.
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9beb1c6e-fc, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9beb1c6e-fc, col_values=(('qos', UUID('ebe3c8c0-d549-40d1-bf87-27fb1afc4ce1')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9beb1c6e-fc, col_values=(('external_ids', {'iface-id': '9beb1c6e-fc84-48f9-948e-aead3886696b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:6c:e4', 'vm-uuid': 'd29505be-335a-4f7c-908c-324750c31205'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:23 user nova-compute[74870]: INFO os_vif [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc')
Nov 28 06:53:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Beginning cold snapshot process
Nov 28 06:53:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] No VIF found with MAC fa:16:3e:dd:6c:e4, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk /opt/stack/data/nova/instances/snapshots/tmpnt8psq10/a23e811d869142d1b530f05f996f2557 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Updated VIF entry in instance network info cache for port 9beb1c6e-fc84-48f9-948e-aead3886696b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG nova.network.neutron [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Updating instance_info_cache with network_info: [{"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Releasing lock "refresh_cache-d29505be-335a-4f7c-908c-324750c31205" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk /opt/stack/data/nova/instances/snapshots/tmpnt8psq10/a23e811d869142d1b530f05f996f2557" returned: 0 in 0.736s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:24 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Snapshot extracted, beginning image upload
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:53:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:25 user nova-compute[74870]: WARNING nova.compute.manager [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 06:53:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:25 user nova-compute[74870]: WARNING nova.compute.manager [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] No waiting events found dispatching network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:25 user nova-compute[74870]: WARNING nova.compute.manager [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received unexpected event network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b for instance with vm_state building and task_state spawning.
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] No waiting events found dispatching network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:28 user nova-compute[74870]: WARNING nova.compute.manager [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received unexpected event network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b for instance with vm_state building and task_state spawning.
Nov 28 06:53:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: d29505be-335a-4f7c-908c-324750c31205] Instance spawned successfully.
Nov 28 06:53:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:53:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7629MB free_disk=25.094451904296875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:53:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Snapshot image upload complete
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:53:28 user nova-compute[74870]: INFO nova.compute.manager [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Shelve offloading
Nov 28 06:53:28 user nova-compute[74870]: INFO nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:53:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance destroyed successfully.
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance de112cbb-849e-43c1-961a-4457585f2e9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d29505be-335a-4f7c-908c-324750c31205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:53:28 user nova-compute[74870]: INFO nova.compute.manager [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Took 7.48 seconds to build instance.
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "d29505be-335a-4f7c-908c-324750c31205" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.589s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance destroyed successfully.
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.objects.instance [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'resources' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-161739875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-161739875',id=34,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgppLb2kNYG5hyeE0SEPq0PFajgXAsCK1knJv+jOVeGkDLsXyFItKhJE8Nomj2oA0/dnErgSFuw7MdhLob2xlyJnLrkin+BS1Fq0CIEv5UHpjZO84gELSv312s7eJMXCA==',key_name='tempest-keypair-259314972',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:51:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-x7x4oe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member',shelved_at='2023-11-28T06:53:28.098306',shelved_host='user',shelved_image_id='75468688-b2a2-485c-9254-3018b05ba68a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:53:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=4fe14a8c-afa2-43b4-a885-914f4c8195ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG os_vif [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc037856-71, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c9638b0-5ae4-4938-9dc6-c1809415aa67) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-changed-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing instance network info cache due to event network-changed-fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.network.neutron [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing network info cache for port fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:29 user nova-compute[74870]: INFO os_vif [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71')
Nov 28 06:53:29 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Deleting instance files /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad_del
Nov 28 06:53:29 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Deletion of /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad_del complete
Nov 28 06:53:29 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Deleted allocations for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad
Nov 28 06:53:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.objects.instance [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'numa_topology' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:29 user nova-compute[74870]: DEBUG nova.objects.base [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<4fe14a8c-afa2-43b4-a885-914f4c8195ad> lazy-loaded attributes: resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updated VIF entry in instance network info cache for port fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfc037856-71", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.458s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:53:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [{"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-de112cbb-849e-43c1-961a-4457585f2e9a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:32 user nova-compute[74870]: INFO nova.compute.manager [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Terminating instance
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-unplugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Instance destroyed successfully.
Nov 28 06:53:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'resources' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621425112',display_name='tempest-ServerRescueNegativeTestJSON-server-1621425112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621425112',id=26,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCT7W9jPmL2DNpNb9OOlPJ8LYFXcuPwkRJcaH1BxAIpcqXX2ZN2vfpsNvMAsDzCxKGMuLnCMHJxT/KP2cJ3GsZiR1qHhSqRW1ZO6lSQzJztb7FbdXbjL1GzTWYUBOtmlQ==',key_name='tempest-keypair-2000231521',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-pcfpikup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=de112cbb-849e-43c1-961a-4457585f2e9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "05ecf301-f2f8-4953-997c-6855e4f27db7", "address": "fa:16:3e:e7:56:7b", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ecf301-f2", "ovs_interfaceid": "05ecf301-f2f8-4953-997c-6855e4f27db7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG os_vif [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05ecf301-f2, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df1e0ce0-5ae5-4584-92b1-cb820a466cef) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:33 user nova-compute[74870]: INFO os_vif [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=05ecf301-f2f8-4953-997c-6855e4f27db7,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ecf301-f2')
Nov 28 06:53:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Deleting instance files /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a_del
Nov 28 06:53:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Deletion of /opt/stack/data/nova/instances/de112cbb-849e-43c1-961a-4457585f2e9a_del complete
Nov 28 06:53:33 user nova-compute[74870]: INFO nova.compute.manager [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 06:53:33 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:53:33 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:34 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Took 0.70 seconds to deallocate network for instance.
Nov 28 06:53:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-deleted-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:34 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Deleted allocations for instance de112cbb-849e-43c1-961a-4457585f2e9a
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "de112cbb-849e-43c1-961a-4457585f2e9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Acquiring lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Lock "de112cbb-849e-43c1-961a-4457585f2e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] No waiting events found dispatching network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:34 user nova-compute[74870]: WARNING nova.compute.manager [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Received unexpected event network-vif-plugged-05ecf301-f2f8-4953-997c-6855e4f27db7 for instance with vm_state deleted and task_state None.
Nov 28 06:53:35 user nova-compute[74870]: INFO nova.compute.manager [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Unrescuing
Nov 28 06:53:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquired lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG nova.network.neutron [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG nova.network.neutron [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating instance_info_cache with network_info: [{"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Releasing lock "refresh_cache-3a328017-e6a2-4b35-a18d-d51a14e29895" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG nova.objects.instance [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'flavor' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:36 user nova-compute[74870]: WARNING nova.compute.manager [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:53:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:37 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance destroyed successfully.
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:38 user nova-compute[74870]: WARNING nova.compute.manager [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:38 user nova-compute[74870]: WARNING nova.compute.manager [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquired lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'info_cache' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:38 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Releasing lock "refresh_cache-bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:53:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance destroyed successfully.
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'resources' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG os_vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20c570c-28, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47738c2f-b403-49e9-a1f5-858c9db55597) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:39 user nova-compute[74870]: INFO os_vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28')
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start _get_guest_xml network_info=[{"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'numa_topology' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:39 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:53:39 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:53:39 user nova-compute[74870]:   <uuid>bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</uuid>
Nov 28 06:53:39 user nova-compute[74870]:   <name>instance-00000018</name>
Nov 28 06:53:39 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:53:39 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:53:39 user nova-compute[74870]:   <metadata>
Nov 28 06:53:39 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:53:39 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:53:39 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeTestJSON-server-1513439293</nova:name>
Nov 28 06:53:39 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:53:39</nova:creationTime>
Nov 28 06:53:39 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:53:39 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:53:39 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:53:39 user nova-compute[74870]:       <nova:owner>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:user uuid="63fdd08d34954e97ae65ec1ce1c3d0f6">tempest-AttachVolumeTestJSON-25504685-project-member</nova:user>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:project uuid="2a4f8529212249d68a54698cffcdc44b">tempest-AttachVolumeTestJSON-25504685</nova:project>
Nov 28 06:53:39 user nova-compute[74870]:       </nova:owner>
Nov 28 06:53:39 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:53:39 user nova-compute[74870]:       <nova:ports>
Nov 28 06:53:39 user nova-compute[74870]:         <nova:port uuid="d20c570c-280d-472a-a11a-3e13c3920461">
Nov 28 06:53:39 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:53:39 user nova-compute[74870]:         </nova:port>
Nov 28 06:53:39 user nova-compute[74870]:       </nova:ports>
Nov 28 06:53:39 user nova-compute[74870]:     </nova:instance>
Nov 28 06:53:39 user nova-compute[74870]:   </metadata>
Nov 28 06:53:39 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:53:39 user nova-compute[74870]:     <system>
Nov 28 06:53:39 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:53:39 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:53:39 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:53:39 user nova-compute[74870]:       <entry name="serial">bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</entry>
Nov 28 06:53:39 user nova-compute[74870]:       <entry name="uuid">bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d</entry>
Nov 28 06:53:39 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:53:39 user nova-compute[74870]:     </system>
Nov 28 06:53:39 user nova-compute[74870]:   </sysinfo>
Nov 28 06:53:39 user nova-compute[74870]:   <os>
Nov 28 06:53:39 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:53:39 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:53:39 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:53:39 user nova-compute[74870]:   </os>
Nov 28 06:53:39 user nova-compute[74870]:   <features>
Nov 28 06:53:39 user nova-compute[74870]:     <acpi/>
Nov 28 06:53:39 user nova-compute[74870]:     <apic/>
Nov 28 06:53:39 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:53:39 user nova-compute[74870]:   </features>
Nov 28 06:53:39 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:53:39 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:53:39 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:53:39 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:53:39 user nova-compute[74870]:   </clock>
Nov 28 06:53:39 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:53:39 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:53:39 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:53:39 user nova-compute[74870]:   </cpu>
Nov 28 06:53:39 user nova-compute[74870]:   <devices>
Nov 28 06:53:39 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:53:39 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:53:39 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk"/>
Nov 28 06:53:39 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:53:39 user nova-compute[74870]:     </disk>
Nov 28 06:53:39 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:53:39 user nova-compute[74870]:       <mac address="fa:16:3e:88:f4:5c"/>
Nov 28 06:53:39 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:53:39 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:53:39 user nova-compute[74870]:       <target dev="tapd20c570c-28"/>
Nov 28 06:53:39 user nova-compute[74870]:     </interface>
Nov 28 06:53:39 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:53:39 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/console.log" append="off"/>
Nov 28 06:53:39 user nova-compute[74870]:     </serial>
Nov 28 06:53:39 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:53:39 user nova-compute[74870]:     <video>
Nov 28 06:53:39 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:53:39 user nova-compute[74870]:     </video>
Nov 28 06:53:39 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:53:39 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:53:39 user nova-compute[74870]:     </rng>
Nov 28 06:53:39 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:53:39 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:53:39 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:53:39 user nova-compute[74870]:     </memballoon>
Nov 28 06:53:39 user nova-compute[74870]:   </devices>
Nov 28 06:53:39 user nova-compute[74870]: </domain>
Nov 28 06:53:39 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'migration_context' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.objects.base [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Object Instance<bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG os_vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb7f9cc8-f611-5d81-a1db-5424875809b0', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20c570c-28, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd20c570c-28, col_values=(('qos', UUID('82194a73-aa21-4828-8814-1716aa8759ee')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd20c570c-28, col_values=(('external_ids', {'iface-id': 'd20c570c-280d-472a-a11a-3e13c3920461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:f4:5c', 'vm-uuid': 'bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:40 user nova-compute[74870]: INFO os_vif [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28')
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:40 user nova-compute[74870]: WARNING nova.compute.manager [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state rescued and task_state unrescuing.
Nov 28 06:53:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG nova.compute.manager [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:42 user nova-compute[74870]: WARNING nova.compute.manager [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state stopped and task_state powering-on.
Nov 28 06:53:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:53:44 user nova-compute[74870]: WARNING nova.compute.manager [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state stopped and task_state powering-on.
Nov 28 06:53:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance rebooted successfully.
Nov 28 06:53:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:53:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:53:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:54:13 user nova-compute[74870]: INFO nova.compute.claims [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Claim successful on node user
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:54:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:54:13 user nova-compute[74870]: DEBUG nova.policy [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:54:14 user nova-compute[74870]: INFO nova.virt.block_device [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Booting with volume 4c9f5caf-7a60-4516-a4f2-a928bca26534 at /dev/vda
Nov 28 06:54:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc2515f-7d09-483a-8b8a-135364bd29ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[444680c5-2d51-4172-887f-3860f0f4eee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[715a09ce-5d84-4e23-a0a8-1d4b370fef25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164b8a8-47e4-4ded-96c2-03aefe262e4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:54:14 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:54:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba3b0b4-03e8-4d57-bf60-7a4f83690f7c]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating existing volume attachment record: 82eabb90-af14-4133-80ff-19a1e92b59e9 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Successfully created port: 9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Successfully updated port: 9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-changed-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Refreshing instance network info cache due to event network-changed-9931d17e-bd7c-4a94-a98b-347ac890bcc2. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance network_info: |[{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:54:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Refreshing network info cache for port 9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:54:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updated VIF entry in instance network info cache for port 9931d17e-bd7c-4a94-a98b-347ac890bcc2. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:54:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:54:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:54:18 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:54:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:54:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Creating image(s)
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Ensure instance console log exists: /opt/stack/data/nova/instances/edb101d9-028e-4191-84a2-1169555a21ad/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Start _get_guest_xml network_info=[{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edb101d9-028e-4191-84a2-1169555a21ad', 'attached_at': '', 'detached_at': '', 'volume_id': '4c9f5caf-7a60-4516-a4f2-a928bca26534', 'serial': '4c9f5caf-7a60-4516-a4f2-a928bca26534'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '82eabb90-af14-4133-80ff-19a1e92b59e9', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:54:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:54:21 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:54:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:54:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:54:21 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a4951-0305-4f62-89fe-7997e7ef5358]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:54:21 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c26026b-b052-4787-8462-0850ddd4f3b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534] added
Nov 28 06:54:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0788885-9e8c-4148-a174-8419656d34e0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff936b13-a9ee-4dcc-b9c5-d3365007624a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sSgjXJpu {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sSgjXJpu" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd0cdec-68de-4171-89fe-58470d01d9d8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sSgjXJpu'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b85fa2-fef6-4ee2-aaa4-47f65feeca66]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f2e64e-c982-4536-a19a-45700823a2ea]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:54:21 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:54:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:54:21 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:54:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a91eff-3ddb-4bbf-8bc4-fd423c4e756f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]
Nov 28 06:54:21 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.
Nov 28 06:54:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1485d86-dddc-46f8-b2ef-f95faecfcaef]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b9c66-31ab-4ec7-8b1e-9818cf5a93f5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:54:21 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:54:21 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:54:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:54:21 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:54:21 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:54:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd1ddfd-d485-4ed8-9dbb-0a348f752dd9]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:54:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23438663962663034', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438663962663034', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:54:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1276738302',display_name='tempest-ServerActionsTestOtherA-server-1276738302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1276738302',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-16mc3gdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=edb101d9-028e-4191-84a2-1169555a21ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'pci_devices' on Instance uuid edb101d9-028e-4191-84a2-1169555a21ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:54:22 user nova-compute[74870]:   <uuid>edb101d9-028e-4191-84a2-1169555a21ad</uuid>
Nov 28 06:54:22 user nova-compute[74870]:   <name>instance-00000025</name>
Nov 28 06:54:22 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:54:22 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:54:22 user nova-compute[74870]:   <metadata>
Nov 28 06:54:22 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:54:22 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:54:22 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherA-server-1276738302</nova:name>
Nov 28 06:54:22 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:54:21</nova:creationTime>
Nov 28 06:54:22 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:54:22 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:54:22 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:54:22 user nova-compute[74870]:       <nova:owner>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:user uuid="b7b9a26798e14399ac1a70568432485e">tempest-ServerActionsTestOtherA-1541374155-project-member</nova:user>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:project uuid="ccf9caaf7cab4c0eb3343ea2c2501481">tempest-ServerActionsTestOtherA-1541374155</nova:project>
Nov 28 06:54:22 user nova-compute[74870]:       </nova:owner>
Nov 28 06:54:22 user nova-compute[74870]:       <nova:ports>
Nov 28 06:54:22 user nova-compute[74870]:         <nova:port uuid="9931d17e-bd7c-4a94-a98b-347ac890bcc2">
Nov 28 06:54:22 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 06:54:22 user nova-compute[74870]:         </nova:port>
Nov 28 06:54:22 user nova-compute[74870]:       </nova:ports>
Nov 28 06:54:22 user nova-compute[74870]:     </nova:instance>
Nov 28 06:54:22 user nova-compute[74870]:   </metadata>
Nov 28 06:54:22 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:54:22 user nova-compute[74870]:     <system>
Nov 28 06:54:22 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:54:22 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:54:22 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:54:22 user nova-compute[74870]:       <entry name="serial">edb101d9-028e-4191-84a2-1169555a21ad</entry>
Nov 28 06:54:22 user nova-compute[74870]:       <entry name="uuid">edb101d9-028e-4191-84a2-1169555a21ad</entry>
Nov 28 06:54:22 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:54:22 user nova-compute[74870]:     </system>
Nov 28 06:54:22 user nova-compute[74870]:   </sysinfo>
Nov 28 06:54:22 user nova-compute[74870]:   <os>
Nov 28 06:54:22 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:54:22 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:54:22 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:54:22 user nova-compute[74870]:   </os>
Nov 28 06:54:22 user nova-compute[74870]:   <features>
Nov 28 06:54:22 user nova-compute[74870]:     <acpi/>
Nov 28 06:54:22 user nova-compute[74870]:     <apic/>
Nov 28 06:54:22 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:54:22 user nova-compute[74870]:   </features>
Nov 28 06:54:22 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:54:22 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:54:22 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:54:22 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:54:22 user nova-compute[74870]:   </clock>
Nov 28 06:54:22 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:54:22 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:54:22 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:54:22 user nova-compute[74870]:   </cpu>
Nov 28 06:54:22 user nova-compute[74870]:   <devices>
Nov 28 06:54:22 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:54:22 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:54:22 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 06:54:22 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:54:22 user nova-compute[74870]:       <serial>4c9f5caf-7a60-4516-a4f2-a928bca26534</serial>
Nov 28 06:54:22 user nova-compute[74870]:     </disk>
Nov 28 06:54:22 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:54:22 user nova-compute[74870]:       <mac address="fa:16:3e:69:a9:51"/>
Nov 28 06:54:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:54:22 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:54:22 user nova-compute[74870]:       <target dev="tap9931d17e-bd"/>
Nov 28 06:54:22 user nova-compute[74870]:     </interface>
Nov 28 06:54:22 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:54:22 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/edb101d9-028e-4191-84a2-1169555a21ad/console.log" append="off"/>
Nov 28 06:54:22 user nova-compute[74870]:     </serial>
Nov 28 06:54:22 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:54:22 user nova-compute[74870]:     <video>
Nov 28 06:54:22 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:54:22 user nova-compute[74870]:     </video>
Nov 28 06:54:22 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:54:22 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:54:22 user nova-compute[74870]:     </rng>
Nov 28 06:54:22 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:54:22 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:54:22 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:54:22 user nova-compute[74870]:     </memballoon>
Nov 28 06:54:22 user nova-compute[74870]:   </devices>
Nov 28 06:54:22 user nova-compute[74870]: </domain>
Nov 28 06:54:22 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:54:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1276738302',display_name='tempest-ServerActionsTestOtherA-server-1276738302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1276738302',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-16mc3gdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=edb101d9-028e-4191-84a2-1169555a21ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG os_vif [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '816613f0-5b3f-56b9-bb62-9cbf1952ab74', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9931d17e-bd, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9931d17e-bd, col_values=(('qos', UUID('bb44c613-b080-4418-bf7c-154d52dcb087')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9931d17e-bd, col_values=(('external_ids', {'iface-id': '9931d17e-bd7c-4a94-a98b-347ac890bcc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a9:51', 'vm-uuid': 'edb101d9-028e-4191-84a2-1169555a21ad'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:22 user nova-compute[74870]: INFO os_vif [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd')
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:54:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No VIF found with MAC fa:16:3e:69:a9:51, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:54:24 user nova-compute[74870]: WARNING nova.compute.manager [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state building and task_state spawning.
Nov 28 06:54:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:54:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:54:25 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance spawned successfully.
Nov 28 06:54:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:54:26 user nova-compute[74870]: WARNING nova.compute.manager [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state building and task_state spawning.
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:26 user nova-compute[74870]: INFO nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 28 06:54:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:54:26 user nova-compute[74870]: INFO nova.compute.manager [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Took 12.91 seconds to build instance.
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.004s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:54:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:54:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:54:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7654MB free_disk=25.070091247558594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance d29505be-335a-4f7c-908c-324750c31205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:54:28 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.157s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 06:54:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:54:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:54:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:54:30 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Updating instance_info_cache with network_info: [{"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-e23537de-fa1e-4cd2-8050-04ef2b911ac8" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:31 user nova-compute[74870]: INFO nova.compute.manager [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Terminating instance
Nov 28 06:54:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-unplugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-unplugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-unplugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Instance destroyed successfully.
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.objects.instance [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'resources' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30674904',display_name='tempest-ServerRescueNegativeTestJSON-server-30674904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30674904',id=2,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-m4bo25mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:11Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=94a8f46d-3105-4486-a8b4-1409c9c544c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "ac8aece2-e749-4b38-8812-e9d4df591f41", "address": "fa:16:3e:35:bc:d7", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aece2-e7", "ovs_interfaceid": "ac8aece2-e749-4b38-8812-e9d4df591f41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG os_vif [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac8aece2-e7, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b5b4cb4-ad4f-4148-8008-ea0fbc80f2c9) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:32 user nova-compute[74870]: INFO os_vif [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=ac8aece2-e749-4b38-8812-e9d4df591f41,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aece2-e7')
Nov 28 06:54:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Deleting instance files /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7_del
Nov 28 06:54:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Deletion of /opt/stack/data/nova/instances/94a8f46d-3105-4486-a8b4-1409c9c544c7_del complete
Nov 28 06:54:32 user nova-compute[74870]: INFO nova.compute.manager [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 06:54:32 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:54:32 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:54:33 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Took 0.39 seconds to deallocate network for instance.
Nov 28 06:54:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-deleted-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:33 user nova-compute[74870]: INFO nova.compute.manager [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Neutron deleted interface ac8aece2-e749-4b38-8812-e9d4df591f41; detaching it from the instance and deleting it from the info cache
Nov 28 06:54:33 user nova-compute[74870]: DEBUG nova.network.neutron [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Detach interface failed, port_id=ac8aece2-e749-4b38-8812-e9d4df591f41, reason: Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:54:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:33 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Deleted allocations for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7
Nov 28 06:54:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.776s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Acquiring lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Lock "94a8f46d-3105-4486-a8b4-1409c9c544c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] No waiting events found dispatching network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:54:34 user nova-compute[74870]: WARNING nova.compute.manager [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Received unexpected event network-vif-plugged-ac8aece2-e749-4b38-8812-e9d4df591f41 for instance with vm_state deleted and task_state None.
Nov 28 06:54:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:35 user nova-compute[74870]: INFO nova.compute.manager [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Terminating instance
Nov 28 06:54:35 user nova-compute[74870]: DEBUG nova.compute.manager [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Instance destroyed successfully.
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lazy-loading 'resources' on Instance uuid 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-520150813',display_name='tempest-VolumesActionsTest-instance-520150813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-520150813',id=35,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4386d41a22343b185f320b3f90d1a83',ramdisk_id='',reservation_id='r-x5ctpn04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1371009149',owner_user_name='tempest-VolumesActionsTest-1371009149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:52:52Z,user_data=None,user_id='9a2c63a8fe9f4992b7ff2aa75a6c4b86',uuid=9a9822ce-81f4-4988-a8c7-d65aa3d7dec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converting VIF {"id": "64772336-969e-475c-8f13-e208982f0df3", "address": "fa:16:3e:bd:71:cd", "network": {"id": "45c733cf-4326-405a-9d99-92df8dc47b61", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2025448341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4386d41a22343b185f320b3f90d1a83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64772336-96", "ovs_interfaceid": "64772336-969e-475c-8f13-e208982f0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG os_vif [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64772336-96, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb8af4e7-a48d-45c2-8e57-3d12ef7464fb) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:36 user nova-compute[74870]: INFO os_vif [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=64772336-969e-475c-8f13-e208982f0df3,network=Network(45c733cf-4326-405a-9d99-92df8dc47b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64772336-96')
Nov 28 06:54:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Deleting instance files /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7_del
Nov 28 06:54:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Deletion of /opt/stack/data/nova/instances/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7_del complete
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-vif-unplugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] No waiting events found dispatching network-vif-unplugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-vif-unplugged-64772336-969e-475c-8f13-e208982f0df3 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Acquiring lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] No waiting events found dispatching network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:54:36 user nova-compute[74870]: WARNING nova.compute.manager [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received unexpected event network-vif-plugged-64772336-969e-475c-8f13-e208982f0df3 for instance with vm_state active and task_state deleting.
Nov 28 06:54:36 user nova-compute[74870]: INFO nova.compute.manager [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:54:36 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Took 0.41 seconds to deallocate network for instance.
Nov 28 06:54:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Received event network-vif-deleted-64772336-969e-475c-8f13-e208982f0df3 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:37 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:54:37 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:54:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:37 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Deleted allocations for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7
Nov 28 06:54:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 0b630563-12cc-467d-8908-e2a8fb230b62 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 5e69254a-5914-4e90-ae6e-bdf28ac716e7 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid e23537de-fa1e-4cd2-8050-04ef2b911ac8 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid d29505be-335a-4f7c-908c-324750c31205 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid edb101d9-028e-4191-84a2-1169555a21ad {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "d29505be-335a-4f7c-908c-324750c31205" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "edb101d9-028e-4191-84a2-1169555a21ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "d29505be-335a-4f7c-908c-324750c31205" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "edb101d9-028e-4191-84a2-1169555a21ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:54:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:54:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:15 user nova-compute[74870]: INFO nova.compute.manager [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Unshelving
Nov 28 06:55:15 user nova-compute[74870]: INFO nova.virt.block_device [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Booting with volume d1afd034-1bbc-43d2-8928-4c42295bcc8a at /dev/vdc
Nov 28 06:55:15 user nova-compute[74870]: DEBUG os_brick.utils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[76554e61-7631-4d0f-afb0-4ada61927510]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[48da4203-1519-4660-a65d-144800501af4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd40d0a-be20-4ee3-b1d8-3ad83fd99a54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a6acc4-41c2-4509-bc15-8b5afe314b46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:55:15 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:55:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b3ad7-94cb-440d-a8eb-c2c6d7bf15c7]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG os_brick.utils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:55:15 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating existing volume attachment record: 7d6ba37d-8a7c-4211-a5dc-43173f3e5b86 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:55:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "d29505be-335a-4f7c-908c-324750c31205" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "d29505be-335a-4f7c-908c-324750c31205-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "d29505be-335a-4f7c-908c-324750c31205-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:17 user nova-compute[74870]: INFO nova.compute.manager [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Terminating instance
Nov 28 06:55:17 user nova-compute[74870]: DEBUG nova.compute.manager [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-vif-unplugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] No waiting events found dispatching network-vif-unplugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-vif-unplugged-9beb1c6e-fc84-48f9-948e-aead3886696b for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:55:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: d29505be-335a-4f7c-908c-324750c31205] Instance destroyed successfully.
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.objects.instance [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lazy-loading 'resources' on Instance uuid d29505be-335a-4f7c-908c-324750c31205 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1227503680',display_name='tempest-VolumesActionsTest-instance-1227503680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1227503680',id=36,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f780d5cb4154beb808bf1232426586b',ramdisk_id='',reservation_id='r-8qf5iq3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1817915228',owner_user_name='tempest-VolumesActionsTest-1817915228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:53:28Z,user_data=None,user_id='62687690bcc64588ab57d9ca8b6ea5ec',uuid=d29505be-335a-4f7c-908c-324750c31205,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Converting VIF {"id": "9beb1c6e-fc84-48f9-948e-aead3886696b", "address": "fa:16:3e:dd:6c:e4", "network": {"id": "b822def6-f451-4dbb-938f-da41df56c19b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-256294719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f780d5cb4154beb808bf1232426586b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9beb1c6e-fc", "ovs_interfaceid": "9beb1c6e-fc84-48f9-948e-aead3886696b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG os_vif [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9beb1c6e-fc, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebe3c8c0-d549-40d1-bf87-27fb1afc4ce1) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:18 user nova-compute[74870]: INFO os_vif [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6c:e4,bridge_name='br-int',has_traffic_filtering=True,id=9beb1c6e-fc84-48f9-948e-aead3886696b,network=Network(b822def6-f451-4dbb-938f-da41df56c19b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9beb1c6e-fc')
Nov 28 06:55:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Deleting instance files /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205_del
Nov 28 06:55:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Deletion of /opt/stack/data/nova/instances/d29505be-335a-4f7c-908c-324750c31205_del complete
Nov 28 06:55:18 user nova-compute[74870]: INFO nova.compute.manager [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 06:55:18 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: d29505be-335a-4f7c-908c-324750c31205] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: d29505be-335a-4f7c-908c-324750c31205] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: d29505be-335a-4f7c-908c-324750c31205] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:18 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: d29505be-335a-4f7c-908c-324750c31205] Took 0.48 seconds to deallocate network for instance.
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-vif-deleted-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:18 user nova-compute[74870]: INFO nova.compute.manager [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Neutron deleted interface 9beb1c6e-fc84-48f9-948e-aead3886696b; detaching it from the instance and deleting it from the info cache
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.network.neutron [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Detach interface failed, port_id=9beb1c6e-fc84-48f9-948e-aead3886696b, reason: Instance d29505be-335a-4f7c-908c-324750c31205 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:19 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Deleted allocations for instance d29505be-335a-4f7c-908c-324750c31205
Nov 28 06:55:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "d29505be-335a-4f7c-908c-324750c31205" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received event network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Acquiring lock "d29505be-335a-4f7c-908c-324750c31205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Lock "d29505be-335a-4f7c-908c-324750c31205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] No waiting events found dispatching network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:19 user nova-compute[74870]: WARNING nova.compute.manager [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] [instance: d29505be-335a-4f7c-908c-324750c31205] Received unexpected event network-vif-plugged-9beb1c6e-fc84-48f9-948e-aead3886696b for instance with vm_state deleted and task_state None.
Nov 28 06:55:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:21 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'pci_requests' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'numa_topology' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:55:22 user nova-compute[74870]: INFO nova.compute.claims [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Claim successful on node user
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:22 user nova-compute[74870]: INFO nova.compute.manager [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Terminating instance
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-unplugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:55:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:22 user nova-compute[74870]: INFO nova.network.neutron [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating port fc037856-716e-436b-b551-55cd7f2497cc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Instance destroyed successfully.
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'resources' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-863344240',display_name='tempest-ServerRescueNegativeTestJSON-server-863344240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-863344240',id=1,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:43:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f90603ba77644568ec6f6fd37689a08',ramdisk_id='',reservation_id='r-3lv7qxhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-226827849',owner_user_name='tempest-ServerRescueNegativeTestJSON-226827849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:44:55Z,user_data=None,user_id='109001cce8ec4aa0b87f271b415cd5e6',uuid=37549ec7-6ded-412f-8a4f-58a7469e4cd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converting VIF {"id": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "address": "fa:16:3e:c3:cb:4e", "network": {"id": "74dfaac2-1093-4fe2-8322-f49e14500d58", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1610257121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f90603ba77644568ec6f6fd37689a08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ce66df-12", "ovs_interfaceid": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG os_vif [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63ce66df-12, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ded64957-fbb6-41c4-a2e7-0afe1388023a) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:23 user nova-compute[74870]: INFO os_vif [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f,network=Network(74dfaac2-1093-4fe2-8322-f49e14500d58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ce66df-12')
Nov 28 06:55:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Deleting instance files /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1_del
Nov 28 06:55:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Deletion of /opt/stack/data/nova/instances/37549ec7-6ded-412f-8a4f-58a7469e4cd1_del complete
Nov 28 06:55:23 user nova-compute[74870]: INFO nova.compute.manager [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:55:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Creating image(s)
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-deleted-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:23 user nova-compute[74870]: INFO nova.compute.manager [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Neutron deleted interface 63ce66df-1214-4fbb-a8f5-8d08c9fb640f; detaching it from the instance and deleting it from the info cache
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG nova.objects.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<4fe14a8c-afa2-43b4-a885-914f4c8195ad> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:24 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Took 0.72 seconds to deallocate network for instance.
Nov 28 06:55:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Detach interface failed, port_id=63ce66df-1214-4fbb-a8f5-8d08c9fb640f, reason: Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:55:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Acquiring lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] No waiting events found dispatching network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:25 user nova-compute[74870]: WARNING nova.compute.manager [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Received unexpected event network-vif-plugged-63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance with vm_state deleted and task_state None.
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-changed-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing instance network info cache due to event network-changed-fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Acquiring lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Acquired lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Refreshing network info cache for port fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.virt.images [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 75468688-b2a2-485c-9254-3018b05ba68a was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.part /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.408s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.part /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.converted" returned: 0 in 0.303s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.425s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:25 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Deleted allocations for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "37549ec7-6ded-412f-8a4f-58a7469e4cd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.204s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.681s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updated VIF entry in instance network info cache for port fc037856-716e-436b-b551-55cd7f2497cc. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Releasing lock "refresh_cache-4fe14a8c-afa2-43b4-a885-914f4c8195ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5,backing_fmt=raw /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5,backing_fmt=raw /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk 1073741824" returned: 0 in 0.050s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'migration_context' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG nova.objects.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<4fe14a8c-afa2-43b4-a885-914f4c8195ad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:55:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Rebasing disk image.
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c -F raw /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:26 user nova-compute[74870]: INFO nova.compute.manager [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Terminating instance
Nov 28 06:55:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Instance destroyed successfully.
Nov 28 06:55:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:55:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=25.03704071044922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'resources' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1304545091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1304545091',id=32,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-yej7ft2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:53:41Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=3a328017-e6a2-4b35-a18d-d51a14e29895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "address": "fa:16:3e:f3:c9:07", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd5f93d-f3", "ovs_interfaceid": "afd5f93d-f360-467a-9e4c-b7816bcd41ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_vif [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafd5f93d-f3, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95ef6824-9e01-458d-a644-fc20c522be8e) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: INFO os_vif [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c9:07,bridge_name='br-int',has_traffic_filtering=True,id=afd5f93d-f360-467a-9e4c-b7816bcd41ae,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd5f93d-f3')
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPNUvdgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:55:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1215c4-e40e-40e5-91f9-8c29f4ca53bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:55:28 user nova-compute[74870]: No targets found.
Nov 28 06:55:28 user nova-compute[74870]: iSNS:
Nov 28 06:55:28 user nova-compute[74870]: No targets found.
Nov 28 06:55:28 user nova-compute[74870]: STATIC:
Nov 28 06:55:28 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:55:28 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:55:28 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:55:28 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b
Nov 28 06:55:28 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:55:28 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:55:28 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:55:28 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:55:28 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:55:28 user nova-compute[74870]: FIRMWARE:
Nov 28 06:55:28 user nova-compute[74870]: No targets found.
Nov 28 06:55:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:55:28 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:55:28 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6447cf-c1f7-4272-ba3a-b1666ba33320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (815baae3-b790-4d61-806d-4eb5745b5a72): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe31d11-dce5-46c2-a4d8-614eb3efc20f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:55:28 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:55:28 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:55:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:55:28 user nova-compute[74870]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b (non-flash)
Nov 28 06:55:28 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:55:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc5a6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a86370-a7b0-4f7a-b73e-2a7125bbc0da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eeb7d8-b6c7-43da-818e-062353ebc8e8]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1ad1bf-bbb6-4781-8155-9592d3665464]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b51a89-9765-4134-b58d-8678dacac861]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1068db3-a717-4222-aff5-5fb9dec9bb14]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c -F raw /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk" returned: 0 in 2.261s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Start _get_guest_xml network_info=[{"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8d2011f754be3285ebcb1d93d9e5fdfc',container_format='bare',created_at=2023-11-28T06:53:23Z,direct_url=<?>,disk_format='qcow2',id=75468688-b2a2-485c-9254-3018b05ba68a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-161739875-shelved',owner='9d769a1c976c468f804770d89c92ae94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T06:53:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSUWObCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4fe14a8c-afa2-43b4-a885-914f4c8195ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1afd034-1bbc-43d2-8928-4c42295bcc8a', 'serial': 'd1afd034-1bbc-43d2-8928-4c42295bcc8a'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '7d6ba37d-8a7c-4211-a5dc-43173f3e5b86', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e495e0-5698-4ad7-918b-6d5175e97235]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260]
Nov 28 06:55:28 user nova-compute[74870]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b, portal: 172.16.0.220,3260] successful.
Nov 28 06:55:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:55:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8d2011f754be3285ebcb1d93d9e5fdfc',container_format='bare',created_at=2023-11-28T06:53:23Z,direct_url=<?>,disk_format='qcow2',id=75468688-b2a2-485c-9254-3018b05ba68a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-161739875-shelved',owner='9d769a1c976c468f804770d89c92ae94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T06:53:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49686c2-d776-448d-ad9b-8e0fc72e9d2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c349bdad-6794-41a6-94bf-bb35341084dc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== disconnect_volume: return (365ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:55:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Deleting instance files /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895_del
Nov 28 06:55:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Deletion of /opt/stack/data/nova/instances/3a328017-e6a2-4b35-a18d-d51a14e29895_del complete
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.objects.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<4fe14a8c-afa2-43b4-a885-914f4c8195ad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSUWObCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:55:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:55:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:55:28 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[490254ff-c716-4181-94e7-41f3f6c93ccd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:55:28 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: INFO nova.compute.manager [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Took 1.89 seconds to destroy the instance on the hypervisor.
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad11841-5021-47f2-8048-7fa458c93758]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a] added
Nov 28 06:55:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacc3fad-b63d-40e0-9fd3-0476009de2a5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9812e47-16da-4ca3-ab02-c837bf3a6a23]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSUWObCc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSUWObCc" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2597287a-1345-4e20-974c-fd4ef32fbb23]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HSUWObCc'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754b0e2-ffe7-453e-acf6-452b2c548632]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fc8d5-cd19-4760-aa2f-df675f5cd4dc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f912b2d2-e391-4a32-a4ea-6f9787c9f2fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260]
Nov 28 06:55:29 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260] successful.
Nov 28 06:55:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f449678-e23b-4eb9-bcfe-e98bab914d2a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd53207f-2e7f-484a-b1bc-6911e598ecdb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:55:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:55:29 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:55:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ab41d0-08a3-4704-9ba4-11cdfc6ec385]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:29 user nova-compute[74870]: WARNING nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state deleting.
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:29 user nova-compute[74870]: WARNING nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state deleting.
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:29 user nova-compute[74870]: WARNING nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state deleting.
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-unplugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Acquiring lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] No waiting events found dispatching network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:29 user nova-compute[74870]: WARNING nova.compute.manager [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received unexpected event network-vif-plugged-afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance with vm_state active and task_state deleting.
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:29 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Took 0.77 seconds to deallocate network for instance.
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Received event network-vif-deleted-afd5f93d-f360-467a-9e4c-b7816bcd41ae {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:29 user nova-compute[74870]: INFO nova.compute.manager [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Neutron deleted interface afd5f93d-f360-467a-9e4c-b7816bcd41ae; detaching it from the instance and deleting it from the info cache
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.network.neutron [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Detach interface failed, port_id=afd5f93d-f360-467a-9e4c-b7816bcd41ae, reason: Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSUWObCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23037366663623632', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037366663623632', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:30 user nova-compute[74870]: INFO nova.compute.manager [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Terminating instance
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-161739875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-161739875',id=34,image_ref='75468688-b2a2-485c-9254-3018b05ba68a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-259314972',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:51:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-x7x4oe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member',shelved_at='2023-11-28T06:53:28.098306',shelved_host='user',shelved_image_id='75468688-b2a2-485c-9254-3018b05ba68a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=4fe14a8c-afa2-43b4-a885-914f4c8195ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.objects.base [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<4fe14a8c-afa2-43b4-a885-914f4c8195ad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:55:30 user nova-compute[74870]:   <uuid>4fe14a8c-afa2-43b4-a885-914f4c8195ad</uuid>
Nov 28 06:55:30 user nova-compute[74870]:   <name>instance-00000022</name>
Nov 28 06:55:30 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:55:30 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:55:30 user nova-compute[74870]:   <metadata>
Nov 28 06:55:30 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:55:30 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:55:30 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-161739875</nova:name>
Nov 28 06:55:30 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:55:28</nova:creationTime>
Nov 28 06:55:30 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:55:30 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:55:30 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:55:30 user nova-compute[74870]:       <nova:owner>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:user uuid="dbf659ad4b8f43a2bc497d01be58d846">tempest-AttachVolumeShelveTestJSON-92318211-project-member</nova:user>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:project uuid="9d769a1c976c468f804770d89c92ae94">tempest-AttachVolumeShelveTestJSON-92318211</nova:project>
Nov 28 06:55:30 user nova-compute[74870]:       </nova:owner>
Nov 28 06:55:30 user nova-compute[74870]:       <nova:root type="image" uuid="75468688-b2a2-485c-9254-3018b05ba68a"/>
Nov 28 06:55:30 user nova-compute[74870]:       <nova:ports>
Nov 28 06:55:30 user nova-compute[74870]:         <nova:port uuid="fc037856-716e-436b-b551-55cd7f2497cc">
Nov 28 06:55:30 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 06:55:30 user nova-compute[74870]:         </nova:port>
Nov 28 06:55:30 user nova-compute[74870]:       </nova:ports>
Nov 28 06:55:30 user nova-compute[74870]:     </nova:instance>
Nov 28 06:55:30 user nova-compute[74870]:   </metadata>
Nov 28 06:55:30 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:55:30 user nova-compute[74870]:     <system>
Nov 28 06:55:30 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:55:30 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:55:30 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:55:30 user nova-compute[74870]:       <entry name="serial">4fe14a8c-afa2-43b4-a885-914f4c8195ad</entry>
Nov 28 06:55:30 user nova-compute[74870]:       <entry name="uuid">4fe14a8c-afa2-43b4-a885-914f4c8195ad</entry>
Nov 28 06:55:30 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:55:30 user nova-compute[74870]:     </system>
Nov 28 06:55:30 user nova-compute[74870]:   </sysinfo>
Nov 28 06:55:30 user nova-compute[74870]:   <os>
Nov 28 06:55:30 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:55:30 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:55:30 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:55:30 user nova-compute[74870]:   </os>
Nov 28 06:55:30 user nova-compute[74870]:   <features>
Nov 28 06:55:30 user nova-compute[74870]:     <acpi/>
Nov 28 06:55:30 user nova-compute[74870]:     <apic/>
Nov 28 06:55:30 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:55:30 user nova-compute[74870]:   </features>
Nov 28 06:55:30 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:55:30 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:55:30 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:55:30 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:55:30 user nova-compute[74870]:   </clock>
Nov 28 06:55:30 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:55:30 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:55:30 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:55:30 user nova-compute[74870]:   </cpu>
Nov 28 06:55:30 user nova-compute[74870]:   <devices>
Nov 28 06:55:30 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:55:30 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:55:30 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk"/>
Nov 28 06:55:30 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:55:30 user nova-compute[74870]:     </disk>
Nov 28 06:55:30 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:55:30 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:55:30 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:55:30 user nova-compute[74870]:       <target dev="vdc" bus="virtio"/>
Nov 28 06:55:30 user nova-compute[74870]:       <serial>d1afd034-1bbc-43d2-8928-4c42295bcc8a</serial>
Nov 28 06:55:30 user nova-compute[74870]:     </disk>
Nov 28 06:55:30 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:55:30 user nova-compute[74870]:       <mac address="fa:16:3e:6b:86:96"/>
Nov 28 06:55:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:55:30 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:55:30 user nova-compute[74870]:       <target dev="tapfc037856-71"/>
Nov 28 06:55:30 user nova-compute[74870]:     </interface>
Nov 28 06:55:30 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:55:30 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/console.log" append="off"/>
Nov 28 06:55:30 user nova-compute[74870]:     </serial>
Nov 28 06:55:30 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:55:30 user nova-compute[74870]:     <video>
Nov 28 06:55:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:55:30 user nova-compute[74870]:     </video>
Nov 28 06:55:30 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:55:30 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:55:30 user nova-compute[74870]:     </rng>
Nov 28 06:55:30 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:55:30 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:55:30 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:55:30 user nova-compute[74870]:     </memballoon>
Nov 28 06:55:30 user nova-compute[74870]:   </devices>
Nov 28 06:55:30 user nova-compute[74870]: </domain>
Nov 28 06:55:30 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-161739875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-161739875',id=34,image_ref='75468688-b2a2-485c-9254-3018b05ba68a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-259314972',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:51:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-x7x4oe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member',shelved_at='2023-11-28T06:53:28.098306',shelved_host='user',shelved_image_id='75468688-b2a2-485c-9254-3018b05ba68a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=4fe14a8c-afa2-43b4-a885-914f4c8195ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG os_vif [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe4cc634-8989-5c84-8079-1c383c4c820c', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc037856-71, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc037856-71, col_values=(('qos', UUID('d032c40f-80f1-4120-b42e-1ce5176b6c6f')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc037856-71, col_values=(('external_ids', {'iface-id': 'fc037856-716e-436b-b551-55cd7f2497cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:86:96', 'vm-uuid': '4fe14a8c-afa2-43b4-a885-914f4c8195ad'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: INFO os_vif [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71')
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No VIF found with MAC fa:16:3e:6b:86:96, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:30 user nova-compute[74870]: INFO nova.compute.manager [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Took 0.91 seconds to detach 1 volumes for instance.
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:55:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:30 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Deleted allocations for instance 3a328017-e6a2-4b35-a18d-d51a14e29895
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "3a328017-e6a2-4b35-a18d-d51a14e29895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.082s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Instance destroyed successfully.
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'resources' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1513439293',display_name='tempest-AttachVolumeTestJSON-server-1513439293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1513439293',id=24,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw==',key_name='tempest-keypair-612979215',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-by1ztz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "d20c570c-280d-472a-a11a-3e13c3920461", "address": "fa:16:3e:88:f4:5c", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c570c-28", "ovs_interfaceid": "d20c570c-280d-472a-a11a-3e13c3920461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG os_vif [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20c570c-28, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82194a73-aa21-4828-8814-1716aa8759ee) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:31 user nova-compute[74870]: INFO os_vif [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:5c,bridge_name='br-int',has_traffic_filtering=True,id=d20c570c-280d-472a-a11a-3e13c3920461,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c570c-28')
Nov 28 06:55:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Deleting instance files /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d_del
Nov 28 06:55:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Deletion of /opt/stack/data/nova/instances/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d_del complete
Nov 28 06:55:31 user nova-compute[74870]: INFO nova.compute.manager [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-unplugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Acquiring lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] No waiting events found dispatching network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:31 user nova-compute[74870]: WARNING nova.compute.manager [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received unexpected event network-vif-plugged-d20c570c-280d-472a-a11a-3e13c3920461 for instance with vm_state active and task_state deleting.
Nov 28 06:55:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:55:32 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Took 0.88 seconds to deallocate network for instance.
Nov 28 06:55:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:32 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Deleted allocations for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d
Nov 28 06:55:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.655s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:55:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:33 user nova-compute[74870]: WARNING nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 06:55:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Received event network-vif-deleted-d20c570c-280d-472a-a11a-3e13c3920461 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:33 user nova-compute[74870]: DEBUG nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:55:33 user nova-compute[74870]: WARNING nova.compute.manager [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 06:55:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:55:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:55:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:55:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:55:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:34 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance spawned successfully.
Nov 28 06:55:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:55:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.713s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:55:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:55:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:55:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-changed-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Refreshing instance network info cache due to event network-changed-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:56:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Refreshing network info cache for port 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:56:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:05 user nova-compute[74870]: DEBUG nova.network.neutron [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updated VIF entry in instance network info cache for port 29bc4fb8-446c-405d-a18f-e0bf5bc21fc9. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:56:05 user nova-compute[74870]: DEBUG nova.network.neutron [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-changed-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Refreshing instance network info cache due to event network-changed-9931d17e-bd7c-4a94-a98b-347ac890bcc2. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Refreshing network info cache for port 9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Stashing vm_state: active {{(pid=74870) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:56:06 user nova-compute[74870]: INFO nova.compute.claims [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Claim successful on node user
Nov 28 06:56:06 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating resource usage from migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updated VIF entry in instance network info cache for port 9931d17e-bd7c-4a94-a98b-347ac890bcc2. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.331s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:06 user nova-compute[74870]: INFO nova.compute.manager [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Migrating
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:06 user nova-compute[74870]: DEBUG nova.network.neutron [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG nova.network.neutron [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Starting migrate_disk_and_power_off {{(pid=74870) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-unplugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG nova.compute.manager [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-unplugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:07 user nova-compute[74870]: WARNING nova.compute.manager [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-unplugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state active and task_state resize_migrating.
Nov 28 06:56:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:08 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance destroyed successfully.
Nov 28 06:56:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:54:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1276738302',display_name='tempest-ServerActionsTestOtherA-server-1276738302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1276738302',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:54:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-16mc3gdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=edb101d9-028e-4191-84a2-1169555a21ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9931d17e-bd, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb44c613-b080-4418-bf7c-154d52dcb087) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:08 user nova-compute[74870]: INFO os_vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd')
Nov 28 06:56:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:56:08 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa8fc2d-2595-4c1a-a8ec-9d5b01639503]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:56:08 user nova-compute[74870]: No targets found.
Nov 28 06:56:08 user nova-compute[74870]: iSNS:
Nov 28 06:56:08 user nova-compute[74870]: No targets found.
Nov 28 06:56:08 user nova-compute[74870]: STATIC:
Nov 28 06:56:08 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:56:08 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:56:08 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:56:08 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:56:08 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:56:08 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:56:08 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a
Nov 28 06:56:08 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:56:08 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:56:08 user nova-compute[74870]: FIRMWARE:
Nov 28 06:56:08 user nova-compute[74870]: No targets found.
Nov 28 06:56:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:56:08 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:56:08 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb5f941-ea99-4d45-a241-6331e0c487e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c218e381-8664-4442-9271-32710b020f35]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:08 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:08 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:08 user nova-compute[74870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:08 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef42f44c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c389fc-17d1-4f0b-b054-abeba8af679e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1892952-c56c-46b8-9d50-3a5abf14a71c]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b1bd1-0fe8-43f6-aca7-1cc0cb36683e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d25d5-d3b9-4068-b6b9-fa0708d4f3af]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23438663962663034', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_38e97997', '/dev/disk/by-id/scsi-1SCST_BIO38e97997-48f9bf0485f471e9') {{(pid=85885) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 06:56:08 user nova-compute[74870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23438663962663034
Nov 28 06:56:08 user nova-compute[74870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_38e97997
Nov 28 06:56:08 user nova-compute[74870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO38e97997-48f9bf0485f471e9
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8c59f-0494-40d9-b1bc-fe0f2ca99033]: (4, None) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db289873-5c68-44e1-957c-a1a7360fd701]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc375ed6-1b16-4bf7-800e-9b19d5815b8f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]
Nov 28 06:56:08 user nova-compute[74870]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.
Nov 28 06:56:08 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eb0da9-0575-40bf-a604-68983eaca9e6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== disconnect_volume: return (349ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:56:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG nova.network.neutron [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Port 9931d17e-bd7c-4a94-a98b-347ac890bcc2 binding to destination host user is already ACTIVE {{(pid=74870) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:09 user nova-compute[74870]: WARNING nova.compute.manager [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state active and task_state resize_migrated.
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG os_brick.utils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d6f9b-49d1-45c3-bac1-35e762dfd1ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41f458-21f4-4d0d-8e11-8dddb6d64328]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ba702d-d8d6-48e5-a41f-d122afc34b99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d024e1f0-626b-4fad-9ccd-bd09e9c21f44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:56:10 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:56:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c1d3e1-a073-4f89-bb28-f3aab900b7a1]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:56:10 user nova-compute[74870]: DEBUG os_brick.utils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:56:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:17 user nova-compute[74870]: INFO nova.compute.manager [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Terminating instance
Nov 28 06:56:17 user nova-compute[74870]: DEBUG nova.compute.manager [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-vif-unplugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] No waiting events found dispatching network-vif-unplugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-vif-unplugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Starting finish_migration {{(pid=74870) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance directory exists: not creating {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 06:56:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Creating image(s)
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Ensure instance console log exists: /opt/stack/data/nova/instances/edb101d9-028e-4191-84a2-1169555a21ad/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Start _get_guest_xml network_info=[{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'edb101d9-028e-4191-84a2-1169555a21ad', 'attached_at': '2023-11-28T06:56:18.000000', 'detached_at': '', 'volume_id': '4c9f5caf-7a60-4516-a4f2-a928bca26534', 'serial': '4c9f5caf-7a60-4516-a4f2-a928bca26534'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '0d73afae-d8b4-441a-98ef-c3e6b9a7c7a8', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:56:18 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:18 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:56:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:56:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:56:18 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[58975ce5-27c8-4a65-a8ca-2515fbaa24e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:56:18 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Instance destroyed successfully.
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.objects.instance [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'resources' on Instance uuid e23537de-fa1e-4cd2-8050-04ef2b911ac8 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1112120856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1112120856',id=27,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:47:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-l8cdhw1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:48:52Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=e23537de-fa1e-4cd2-8050-04ef2b911ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "address": "fa:16:3e:1c:23:dc", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af514bf-1b", "ovs_interfaceid": "0af514bf-1b38-47e8-97a8-7e1c3d34246a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_vif [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0af514bf-1b, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b71d0-882e-49ed-9172-38930edcdac3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534] added
Nov 28 06:56:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc9a1b72-c5cd-41da-aa08-b3bacbbc47f1) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:18 user nova-compute[74870]: INFO os_vif [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:23:dc,bridge_name='br-int',has_traffic_filtering=True,id=0af514bf-1b38-47e8-97a8-7e1c3d34246a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af514bf-1b')
Nov 28 06:56:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Deleting instance files /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8_del
Nov 28 06:56:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Deletion of /opt/stack/data/nova/instances/e23537de-fa1e-4cd2-8050-04ef2b911ac8_del complete
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[04871ddd-141c-4397-9961-48e60c54405b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc000e-0db3-4ec9-9352-152da4be29ff]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sSgjXJpu {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sSgjXJpu" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a90764b-87f3-4fec-bbf1-723b9269890c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sSgjXJpu'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: INFO nova.compute.manager [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5eaa04-cc03-4165-b30d-c47d299f93b6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ab49d-a456-47bc-8945-2ae952dfe939]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:18 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:18 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c7e92-b851-4ae5-91a2-fe152ec45a26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]
Nov 28 06:56:18 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.
Nov 28 06:56:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12222be7-ea99-46dc-8682-892cbcfdcefa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b701790c-b9d8-4b0a-9103-2bf59484636b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:18 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:18 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:18 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:18 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[62259c0c-507b-4baa-9672-2c457541dbc0]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:19 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Took 0.53 seconds to deallocate network for instance.
Nov 28 06:56:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:19 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Deleted allocations for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.739s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23438663962663034', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438663962663034', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:54:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1276738302',display_name='tempest-ServerActionsTestOtherA-server-1276738302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1276738302',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:54:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-16mc3gdc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=edb101d9-028e-4191-84a2-1169555a21ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:56:19 user nova-compute[74870]:   <uuid>edb101d9-028e-4191-84a2-1169555a21ad</uuid>
Nov 28 06:56:19 user nova-compute[74870]:   <name>instance-00000025</name>
Nov 28 06:56:19 user nova-compute[74870]:   <memory>2097152</memory>
Nov 28 06:56:19 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:56:19 user nova-compute[74870]:   <metadata>
Nov 28 06:56:19 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:56:19 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:56:19 user nova-compute[74870]:       <nova:name>tempest-ServerActionsTestOtherA-server-1276738302</nova:name>
Nov 28 06:56:19 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:56:18</nova:creationTime>
Nov 28 06:56:19 user nova-compute[74870]:       <nova:flavor name="m1.small">
Nov 28 06:56:19 user nova-compute[74870]:         <nova:memory>2048</nova:memory>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:disk>20</nova:disk>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:56:19 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:56:19 user nova-compute[74870]:       <nova:owner>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:user uuid="b7b9a26798e14399ac1a70568432485e">tempest-ServerActionsTestOtherA-1541374155-project-member</nova:user>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:project uuid="ccf9caaf7cab4c0eb3343ea2c2501481">tempest-ServerActionsTestOtherA-1541374155</nova:project>
Nov 28 06:56:19 user nova-compute[74870]:       </nova:owner>
Nov 28 06:56:19 user nova-compute[74870]:       <nova:ports>
Nov 28 06:56:19 user nova-compute[74870]:         <nova:port uuid="9931d17e-bd7c-4a94-a98b-347ac890bcc2">
Nov 28 06:56:19 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 06:56:19 user nova-compute[74870]:         </nova:port>
Nov 28 06:56:19 user nova-compute[74870]:       </nova:ports>
Nov 28 06:56:19 user nova-compute[74870]:     </nova:instance>
Nov 28 06:56:19 user nova-compute[74870]:   </metadata>
Nov 28 06:56:19 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:56:19 user nova-compute[74870]:     <system>
Nov 28 06:56:19 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:56:19 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:56:19 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:56:19 user nova-compute[74870]:       <entry name="serial">edb101d9-028e-4191-84a2-1169555a21ad</entry>
Nov 28 06:56:19 user nova-compute[74870]:       <entry name="uuid">edb101d9-028e-4191-84a2-1169555a21ad</entry>
Nov 28 06:56:19 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:56:19 user nova-compute[74870]:     </system>
Nov 28 06:56:19 user nova-compute[74870]:   </sysinfo>
Nov 28 06:56:19 user nova-compute[74870]:   <os>
Nov 28 06:56:19 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:56:19 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:56:19 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:56:19 user nova-compute[74870]:   </os>
Nov 28 06:56:19 user nova-compute[74870]:   <features>
Nov 28 06:56:19 user nova-compute[74870]:     <acpi/>
Nov 28 06:56:19 user nova-compute[74870]:     <apic/>
Nov 28 06:56:19 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:56:19 user nova-compute[74870]:   </features>
Nov 28 06:56:19 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:56:19 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:56:19 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:56:19 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:56:19 user nova-compute[74870]:   </clock>
Nov 28 06:56:19 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:56:19 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:56:19 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:56:19 user nova-compute[74870]:   </cpu>
Nov 28 06:56:19 user nova-compute[74870]:   <devices>
Nov 28 06:56:19 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:56:19 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:56:19 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 06:56:19 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:56:19 user nova-compute[74870]:       <serial>4c9f5caf-7a60-4516-a4f2-a928bca26534</serial>
Nov 28 06:56:19 user nova-compute[74870]:     </disk>
Nov 28 06:56:19 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:56:19 user nova-compute[74870]:       <mac address="fa:16:3e:69:a9:51"/>
Nov 28 06:56:19 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:56:19 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:56:19 user nova-compute[74870]:       <target dev="tap9931d17e-bd"/>
Nov 28 06:56:19 user nova-compute[74870]:     </interface>
Nov 28 06:56:19 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:56:19 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/edb101d9-028e-4191-84a2-1169555a21ad/console.log" append="off"/>
Nov 28 06:56:19 user nova-compute[74870]:     </serial>
Nov 28 06:56:19 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:56:19 user nova-compute[74870]:     <video>
Nov 28 06:56:19 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:56:19 user nova-compute[74870]:     </video>
Nov 28 06:56:19 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:56:19 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:56:19 user nova-compute[74870]:     </rng>
Nov 28 06:56:19 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:56:19 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:56:19 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:56:19 user nova-compute[74870]:     </memballoon>
Nov 28 06:56:19 user nova-compute[74870]:   </devices>
Nov 28 06:56:19 user nova-compute[74870]: </domain>
Nov 28 06:56:19 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:54:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1276738302',display_name='tempest-ServerActionsTestOtherA-server-1276738302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1276738302',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:54:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-16mc3gdc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=edb101d9-028e-4191-84a2-1169555a21ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1871231598-network", "vif_mac": "fa:16:3e:69:a9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG os_vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '816613f0-5b3f-56b9-bb62-9cbf1952ab74', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9931d17e-bd, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9931d17e-bd, col_values=(('qos', UUID('5186f93f-c1ac-40fb-9b16-3c031236076a')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9931d17e-bd, col_values=(('external_ids', {'iface-id': '9931d17e-bd7c-4a94-a98b-347ac890bcc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a9:51', 'vm-uuid': 'edb101d9-028e-4191-84a2-1169555a21ad'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:19 user nova-compute[74870]: INFO os_vif [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd')
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:56:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] No VIF found with MAC fa:16:3e:69:a9:51, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:56:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Acquiring lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Lock "e23537de-fa1e-4cd2-8050-04ef2b911ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] No waiting events found dispatching network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:20 user nova-compute[74870]: WARNING nova.compute.manager [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received unexpected event network-vif-plugged-0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance with vm_state deleted and task_state None.
Nov 28 06:56:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Received event network-vif-deleted-0af514bf-1b38-47e8-97a8-7e1c3d34246a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:22 user nova-compute[74870]: WARNING nova.compute.manager [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state active and task_state resize_finish.
Nov 28 06:56:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:22 user nova-compute[74870]: WARNING nova.compute.manager [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state active and task_state resize_finish.
Nov 28 06:56:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:56:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance running successfully.
Nov 28 06:56:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Failed to set time: agent not configured {{(pid=74870) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 06:56:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] finish_migration finished successfully. {{(pid=74870) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:56:24 user nova-compute[74870]: INFO nova.compute.claims [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Claim successful on node user
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:56:25 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:56:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.policy [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:56:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Creating image(s)
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "/opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "/opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "/opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.279033660888672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Applying migration context for instance edb101d9-028e-4191-84a2-1169555a21ad as it has an incoming, in-progress migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48. Migration status is finished {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 06:56:26 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating resource usage from migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.249s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance eea1149f-7553-4beb-b8df-87822bd3abd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance af3a583a-f470-4959-8515-1b1ddfe471c0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.225s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk 1073741824" returned: 0 in 0.083s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Successfully created port: 97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.240s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:56:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.815s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.618s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:56:27 user nova-compute[74870]: INFO nova.compute.claims [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Claim successful on node user
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Cannot resize image /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Ensure instance console log exists: /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:56:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.policy [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:56:27 user nova-compute[74870]: INFO nova.virt.block_device [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Booting with volume snapshot 7b571a74-5548-4cb5-9f9f-190fbed2a045 at /dev/vda
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Successfully updated port: 97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquired lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-changed-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Refreshing instance network info cache due to event network-changed-97da79b7-c41c-46da-8faa-03d072c630a6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Acquiring lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:27 user nova-compute[74870]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updating instance_info_cache with network_info: [{"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Releasing lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Instance network_info: |[{"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Acquired lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Refreshing network info cache for port 97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Start _get_guest_xml network_info=[{"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:56:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1534702303',display_name='tempest-AttachVolumeTestJSON-server-1534702303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1534702303',id=38,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeL1D4XRxzvT/Z60Ib+3FUK5/1PR8cLQz940qRyjWckwR3Q22IKZERaEWQ61+imcHTbDt7QT2R5/EA26wbBSfVguaOQgWpLV4txliTaqKMuQOQdMsadd/OnwheDO3H/5Q==',key_name='tempest-keypair-34936543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-nvvaxff8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=92e60471-f6da-476c-b0de-c729eec1b2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:56:28 user nova-compute[74870]:   <uuid>92e60471-f6da-476c-b0de-c729eec1b2b4</uuid>
Nov 28 06:56:28 user nova-compute[74870]:   <name>instance-00000026</name>
Nov 28 06:56:28 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:56:28 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:56:28 user nova-compute[74870]:   <metadata>
Nov 28 06:56:28 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:56:28 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:56:28 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeTestJSON-server-1534702303</nova:name>
Nov 28 06:56:28 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:56:28</nova:creationTime>
Nov 28 06:56:28 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:56:28 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:56:28 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:56:28 user nova-compute[74870]:       <nova:owner>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:user uuid="63fdd08d34954e97ae65ec1ce1c3d0f6">tempest-AttachVolumeTestJSON-25504685-project-member</nova:user>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:project uuid="2a4f8529212249d68a54698cffcdc44b">tempest-AttachVolumeTestJSON-25504685</nova:project>
Nov 28 06:56:28 user nova-compute[74870]:       </nova:owner>
Nov 28 06:56:28 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:56:28 user nova-compute[74870]:       <nova:ports>
Nov 28 06:56:28 user nova-compute[74870]:         <nova:port uuid="97da79b7-c41c-46da-8faa-03d072c630a6">
Nov 28 06:56:28 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 06:56:28 user nova-compute[74870]:         </nova:port>
Nov 28 06:56:28 user nova-compute[74870]:       </nova:ports>
Nov 28 06:56:28 user nova-compute[74870]:     </nova:instance>
Nov 28 06:56:28 user nova-compute[74870]:   </metadata>
Nov 28 06:56:28 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:56:28 user nova-compute[74870]:     <system>
Nov 28 06:56:28 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:56:28 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:56:28 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:56:28 user nova-compute[74870]:       <entry name="serial">92e60471-f6da-476c-b0de-c729eec1b2b4</entry>
Nov 28 06:56:28 user nova-compute[74870]:       <entry name="uuid">92e60471-f6da-476c-b0de-c729eec1b2b4</entry>
Nov 28 06:56:28 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:56:28 user nova-compute[74870]:     </system>
Nov 28 06:56:28 user nova-compute[74870]:   </sysinfo>
Nov 28 06:56:28 user nova-compute[74870]:   <os>
Nov 28 06:56:28 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:56:28 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:56:28 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:56:28 user nova-compute[74870]:   </os>
Nov 28 06:56:28 user nova-compute[74870]:   <features>
Nov 28 06:56:28 user nova-compute[74870]:     <acpi/>
Nov 28 06:56:28 user nova-compute[74870]:     <apic/>
Nov 28 06:56:28 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:56:28 user nova-compute[74870]:   </features>
Nov 28 06:56:28 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:56:28 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:56:28 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:56:28 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:56:28 user nova-compute[74870]:   </clock>
Nov 28 06:56:28 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:56:28 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:56:28 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:56:28 user nova-compute[74870]:   </cpu>
Nov 28 06:56:28 user nova-compute[74870]:   <devices>
Nov 28 06:56:28 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:56:28 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:56:28 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk"/>
Nov 28 06:56:28 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:56:28 user nova-compute[74870]:     </disk>
Nov 28 06:56:28 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:56:28 user nova-compute[74870]:       <mac address="fa:16:3e:27:6d:c1"/>
Nov 28 06:56:28 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:56:28 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:56:28 user nova-compute[74870]:       <target dev="tap97da79b7-c4"/>
Nov 28 06:56:28 user nova-compute[74870]:     </interface>
Nov 28 06:56:28 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:56:28 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/console.log" append="off"/>
Nov 28 06:56:28 user nova-compute[74870]:     </serial>
Nov 28 06:56:28 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:56:28 user nova-compute[74870]:     <video>
Nov 28 06:56:28 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:56:28 user nova-compute[74870]:     </video>
Nov 28 06:56:28 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:56:28 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:56:28 user nova-compute[74870]:     </rng>
Nov 28 06:56:28 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:56:28 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:56:28 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:56:28 user nova-compute[74870]:     </memballoon>
Nov 28 06:56:28 user nova-compute[74870]:   </devices>
Nov 28 06:56:28 user nova-compute[74870]: </domain>
Nov 28 06:56:28 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1534702303',display_name='tempest-AttachVolumeTestJSON-server-1534702303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1534702303',id=38,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeL1D4XRxzvT/Z60Ib+3FUK5/1PR8cLQz940qRyjWckwR3Q22IKZERaEWQ61+imcHTbDt7QT2R5/EA26wbBSfVguaOQgWpLV4txliTaqKMuQOQdMsadd/OnwheDO3H/5Q==',key_name='tempest-keypair-34936543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-nvvaxff8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=92e60471-f6da-476c-b0de-c729eec1b2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG os_vif [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f207dc7e-e328-59eb-b481-1ea772c7f9bf', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97da79b7-c4, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97da79b7-c4, col_values=(('qos', UUID('9621b144-38ea-456e-b10f-3296583d0643')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97da79b7-c4, col_values=(('external_ids', {'iface-id': '97da79b7-c41c-46da-8faa-03d072c630a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:6d:c1', 'vm-uuid': '92e60471-f6da-476c-b0de-c729eec1b2b4'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:28 user nova-compute[74870]: INFO os_vif [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4')
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Successfully created port: 75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No VIF found with MAC fa:16:3e:27:6d:c1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updated VIF entry in instance network info cache for port 97da79b7-c41c-46da-8faa-03d072c630a6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG nova.network.neutron [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updating instance_info_cache with network_info: [{"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Releasing lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Skipping network cache update for instance because it is Building. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Skipping network cache update for instance because it is Building. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 0b630563-12cc-467d-8908-e2a8fb230b62 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Successfully updated port: 75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "refresh_cache-af3a583a-f470-4959-8515-1b1ddfe471c0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquired lock "refresh_cache-af3a583a-f470-4959-8515-1b1ddfe471c0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-changed-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Refreshing instance network info cache due to event network-changed-75d293fb-d78b-480f-a0a9-0f98b3d606e7. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Acquiring lock "refresh_cache-af3a583a-f470-4959-8515-1b1ddfe471c0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updating instance_info_cache with network_info: [{"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-0b630563-12cc-467d-8908-e2a8fb230b62" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Updating instance_info_cache with network_info: [{"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] No waiting events found dispatching network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:30 user nova-compute[74870]: WARNING nova.compute.manager [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received unexpected event network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 for instance with vm_state building and task_state spawning.
Nov 28 06:56:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Releasing lock "refresh_cache-af3a583a-f470-4959-8515-1b1ddfe471c0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Instance network_info: |[{"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Acquired lock "refresh_cache-af3a583a-f470-4959-8515-1b1ddfe471c0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Refreshing network info cache for port 75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Updated VIF entry in instance network info cache for port 75d293fb-d78b-480f-a0a9-0f98b3d606e7. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG nova.network.neutron [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Updating instance_info_cache with network_info: [{"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:56:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Releasing lock "refresh_cache-af3a583a-f470-4959-8515-1b1ddfe471c0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] No waiting events found dispatching network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:32 user nova-compute[74870]: WARNING nova.compute.manager [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received unexpected event network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 for instance with vm_state building and task_state spawning.
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:56:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Instance spawned successfully.
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:32 user nova-compute[74870]: INFO nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 28 06:56:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:56:32 user nova-compute[74870]: INFO nova.compute.manager [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Took 8.11 seconds to build instance.
Nov 28 06:56:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.230s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG os_brick.utils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e682b-a36e-42eb-91ea-6277b826cbec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9923105-8f9b-406a-9270-78f1a89ac633]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8e19f6-e917-4bef-8912-6d46d1b8f650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad0594-acda-42a9-b840-d1987c3453b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:56:33 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:56:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea3cfaf-736a-4e30-8a76-2df4260caa44]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG os_brick.utils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:56:33 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Updating existing volume attachment record: 98c29038-2d72-425a-9778-4d6bb2d6acc2 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:56:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:56:35 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:56:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:56:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Creating image(s)
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Ensure instance console log exists: /opt/stack/data/nova/instances/af3a583a-f470-4959-8515-1b1ddfe471c0/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Start _get_guest_xml network_info=[{"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdYmiWLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af3a583a-f470-4959-8515-1b1ddfe471c0', 'attached_at': '', 'detached_at': '', 'volume_id': '071d34bb-0a10-4713-9fe1-c232ea56facf', 'serial': '071d34bb-0a10-4713-9fe1-c232ea56facf'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '98c29038-2d72-425a-9778-4d6bb2d6acc2', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:56:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:56:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdYmiWLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:56:44 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:56:44 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:56:44 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86d3029-447f-4e65-8131-9165485f3969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:56:44 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13d9864-29b0-4d53-987d-6730befa71fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf] added
Nov 28 06:56:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c8885d-17af-42d6-bffb-394b672a5d08]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd9b0c-c5a9-413d-92e1-fe061aaeeed1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdYmiWLx {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdYmiWLx" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026740f-ae72-4d9b-a79c-68f0f7498877]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdYmiWLx'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4342f-03fe-471a-ab56-828b52c8b805]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82934a39-7779-43e4-96da-10c4d274296a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[add03138-a22e-48d9-84f4-3e68abd45804]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260]
Nov 28 06:56:44 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260] successful.
Nov 28 06:56:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b4054f-f586-45d7-a05f-f1bbdc13a6c3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e17452-5dd5-4be9-8eba-de353f011576]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:56:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:56:44 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:56:44 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c617bc-539e-41ce-bceb-395912709dc6]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:56:44 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdYmiWLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:56:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:56:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26563376138323263', 'path': '/dev/sde'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:56:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563376138323263', 'path': '/dev/sde'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1819608978',display_name='tempest-TestVolumeBootPattern-server-1819608978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1819608978',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-hxfns764',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:28Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=af3a583a-f470-4959-8515-1b1ddfe471c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'pci_devices' on Instance uuid af3a583a-f470-4959-8515-1b1ddfe471c0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:56:46 user nova-compute[74870]:   <uuid>af3a583a-f470-4959-8515-1b1ddfe471c0</uuid>
Nov 28 06:56:46 user nova-compute[74870]:   <name>instance-00000027</name>
Nov 28 06:56:46 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:56:46 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:56:46 user nova-compute[74870]:   <metadata>
Nov 28 06:56:46 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:56:46 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:56:46 user nova-compute[74870]:       <nova:name>tempest-TestVolumeBootPattern-server-1819608978</nova:name>
Nov 28 06:56:46 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:56:44</nova:creationTime>
Nov 28 06:56:46 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:56:46 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:56:46 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:56:46 user nova-compute[74870]:       <nova:owner>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:user uuid="2139976b453e4bd2b8e83e551a0cc772">tempest-TestVolumeBootPattern-1541228194-project-member</nova:user>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:project uuid="cecfa8e54acf42a8affd8686f500d6c9">tempest-TestVolumeBootPattern-1541228194</nova:project>
Nov 28 06:56:46 user nova-compute[74870]:       </nova:owner>
Nov 28 06:56:46 user nova-compute[74870]:       <nova:ports>
Nov 28 06:56:46 user nova-compute[74870]:         <nova:port uuid="75d293fb-d78b-480f-a0a9-0f98b3d606e7">
Nov 28 06:56:46 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 06:56:46 user nova-compute[74870]:         </nova:port>
Nov 28 06:56:46 user nova-compute[74870]:       </nova:ports>
Nov 28 06:56:46 user nova-compute[74870]:     </nova:instance>
Nov 28 06:56:46 user nova-compute[74870]:   </metadata>
Nov 28 06:56:46 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:56:46 user nova-compute[74870]:     <system>
Nov 28 06:56:46 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:56:46 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:56:46 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:56:46 user nova-compute[74870]:       <entry name="serial">af3a583a-f470-4959-8515-1b1ddfe471c0</entry>
Nov 28 06:56:46 user nova-compute[74870]:       <entry name="uuid">af3a583a-f470-4959-8515-1b1ddfe471c0</entry>
Nov 28 06:56:46 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:56:46 user nova-compute[74870]:     </system>
Nov 28 06:56:46 user nova-compute[74870]:   </sysinfo>
Nov 28 06:56:46 user nova-compute[74870]:   <os>
Nov 28 06:56:46 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:56:46 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:56:46 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:56:46 user nova-compute[74870]:   </os>
Nov 28 06:56:46 user nova-compute[74870]:   <features>
Nov 28 06:56:46 user nova-compute[74870]:     <acpi/>
Nov 28 06:56:46 user nova-compute[74870]:     <apic/>
Nov 28 06:56:46 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:56:46 user nova-compute[74870]:   </features>
Nov 28 06:56:46 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:56:46 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:56:46 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:56:46 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:56:46 user nova-compute[74870]:   </clock>
Nov 28 06:56:46 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:56:46 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:56:46 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:56:46 user nova-compute[74870]:   </cpu>
Nov 28 06:56:46 user nova-compute[74870]:   <devices>
Nov 28 06:56:46 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:56:46 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:56:46 user nova-compute[74870]:       <source dev="/dev/sde"/>
Nov 28 06:56:46 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:56:46 user nova-compute[74870]:       <serial>071d34bb-0a10-4713-9fe1-c232ea56facf</serial>
Nov 28 06:56:46 user nova-compute[74870]:     </disk>
Nov 28 06:56:46 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:56:46 user nova-compute[74870]:       <mac address="fa:16:3e:10:58:58"/>
Nov 28 06:56:46 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:56:46 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:56:46 user nova-compute[74870]:       <target dev="tap75d293fb-d7"/>
Nov 28 06:56:46 user nova-compute[74870]:     </interface>
Nov 28 06:56:46 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:56:46 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/af3a583a-f470-4959-8515-1b1ddfe471c0/console.log" append="off"/>
Nov 28 06:56:46 user nova-compute[74870]:     </serial>
Nov 28 06:56:46 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:56:46 user nova-compute[74870]:     <video>
Nov 28 06:56:46 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:56:46 user nova-compute[74870]:     </video>
Nov 28 06:56:46 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:56:46 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:56:46 user nova-compute[74870]:     </rng>
Nov 28 06:56:46 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:56:46 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:56:46 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:56:46 user nova-compute[74870]:     </memballoon>
Nov 28 06:56:46 user nova-compute[74870]:   </devices>
Nov 28 06:56:46 user nova-compute[74870]: </domain>
Nov 28 06:56:46 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1819608978',display_name='tempest-TestVolumeBootPattern-server-1819608978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1819608978',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-hxfns764',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:56:28Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=af3a583a-f470-4959-8515-1b1ddfe471c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG os_vif [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69c00b7e-49d3-5cd5-80d1-b7038e988e7a', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75d293fb-d7, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75d293fb-d7, col_values=(('qos', UUID('3e4538e8-3fbc-4b41-aa12-74941fd8abb6')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75d293fb-d7, col_values=(('external_ids', {'iface-id': '75d293fb-d78b-480f-a0a9-0f98b3d606e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:58:58', 'vm-uuid': 'af3a583a-f470-4959-8515-1b1ddfe471c0'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:46 user nova-compute[74870]: INFO os_vif [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7')
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No VIF found with MAC fa:16:3e:10:58:58, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:56:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] No waiting events found dispatching network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:47 user nova-compute[74870]: WARNING nova.compute.manager [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received unexpected event network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance with vm_state building and task_state spawning.
Nov 28 06:56:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:56:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Instance spawned successfully.
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:56:49 user nova-compute[74870]: INFO nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:56:49 user nova-compute[74870]: INFO nova.compute.manager [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Took 23.54 seconds to build instance.
Nov 28 06:56:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.801s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:56:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] No waiting events found dispatching network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:56:49 user nova-compute[74870]: WARNING nova.compute.manager [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received unexpected event network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance with vm_state active and task_state None.
Nov 28 06:56:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:56:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:05 user nova-compute[74870]: INFO nova.compute.manager [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Detaching volume d1afd034-1bbc-43d2-8928-4c42295bcc8a
Nov 28 06:57:05 user nova-compute[74870]: INFO nova.virt.block_device [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Attempting to driver detach volume d1afd034-1bbc-43d2-8928-4c42295bcc8a from mountpoint /dev/vdc
Nov 28 06:57:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Attempting to detach device vdc from instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:57:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:57:05 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:57:05 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:57:05 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:57:05 user nova-compute[74870]:   <serial>d1afd034-1bbc-43d2-8928-4c42295bcc8a</serial>
Nov 28 06:57:05 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 06:57:05 user nova-compute[74870]: </disk>
Nov 28 06:57:05 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:57:05 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully detached device vdc from instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad from the persistent domain config.
Nov 28 06:57:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:57:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:57:05 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:57:05 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:57:05 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:57:05 user nova-compute[74870]:   <serial>d1afd034-1bbc-43d2-8928-4c42295bcc8a</serial>
Nov 28 06:57:05 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 06:57:05 user nova-compute[74870]: </disk>
Nov 28 06:57:05 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:57:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:08 user nova-compute[74870]: INFO nova.compute.manager [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Terminating instance
Nov 28 06:57:08 user nova-compute[74870]: DEBUG nova.compute.manager [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-unplugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Instance destroyed successfully.
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.objects.instance [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'resources' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1924475466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1924475466',id=16,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-r9228def',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:45:07Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=eea1149f-7553-4beb-b8df-87822bd3abd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "address": "fa:16:3e:d5:81:50", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fa54ed-54", "ovs_interfaceid": "d2fa54ed-54c8-4e8f-8009-95df2712735d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_vif [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2fa54ed-54, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41fb1953-5d9e-4b7a-a58d-4e59258bdbd4) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: INFO os_vif [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:81:50,bridge_name='br-int',has_traffic_filtering=True,id=d2fa54ed-54c8-4e8f-8009-95df2712735d,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fa54ed-54')
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMnUjhmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:57:09 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb4af84-2d6b-4aaa-afab-72d7cfbaf71f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:57:09 user nova-compute[74870]: No targets found.
Nov 28 06:57:09 user nova-compute[74870]: iSNS:
Nov 28 06:57:09 user nova-compute[74870]: No targets found.
Nov 28 06:57:09 user nova-compute[74870]: STATIC:
Nov 28 06:57:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:57:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf
Nov 28 06:57:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1
Nov 28 06:57:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:09 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a
Nov 28 06:57:09 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:09 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:09 user nova-compute[74870]: FIRMWARE:
Nov 28 06:57:09 user nova-compute[74870]: No targets found.
Nov 28 06:57:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:57:09 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:57:09 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c31ff8-9ba7-45d4-9c25-0234b935aa48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[79263fc0-7a8b-4da4-a5fd-f1c93b60c4d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:57:09 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:57:09 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:57:09 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:57:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 (non-flash)
Nov 28 06:57:09 user nova-compute[74870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:57:09 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:57:09 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:57:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc395a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1'): ({'sdd'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Removing single pathed devices sdd {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[468c785f-26f7-43bd-afe3-3d318719445b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c6c8df-ff52-418f-8103-9cef0c351347]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flushing IO for device /dev/sdd {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94824af8-f7fb-4b0e-97cd-1d825e205721]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e012b052-d72e-496a-9229-525b86b5114e]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cdcc78-af9e-4bc3-a4db-5d54668e2a34]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90601d56-e3ce-4d3d-9bda-de91b92458cf]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260]
Nov 28 06:57:09 user nova-compute[74870]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1, portal: 172.16.0.220,3260] successful.
Nov 28 06:57:09 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2e80c8-217c-4493-967b-ecae0b6fe4e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac7118f-6b9e-4e7b-b062-cd608832c818]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] <== disconnect_volume: return (331ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:57:09 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Deleting instance files /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5_del
Nov 28 06:57:09 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Deletion of /opt/stack/data/nova/instances/eea1149f-7553-4beb-b8df-87822bd3abd5_del complete
Nov 28 06:57:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:09 user nova-compute[74870]: INFO nova.compute.manager [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "038840e0-306b-466b-8dea-75d8cf2ea261" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:57:09 user nova-compute[74870]: INFO nova.compute.claims [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Claim successful on node user
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:09 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Took 0.46 seconds to deallocate network for instance.
Nov 28 06:57:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-deleted-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:57:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.policy [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97c40e11f74d48798534d16ef676529f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be34184767f4a7b8ebc4754702407d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:57:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Creating image(s)
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "/opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "/opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "/opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Acquiring lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] No waiting events found dispatching network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:10 user nova-compute[74870]: WARNING nova.compute.manager [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Received unexpected event network-vif-plugged-d2fa54ed-54c8-4e8f-8009-95df2712735d for instance with vm_state active and task_state deleting.
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:10 user nova-compute[74870]: INFO nova.compute.manager [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Took 0.89 seconds to detach 1 volumes for instance.
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk 1073741824" returned: 0 in 0.060s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Successfully created port: 486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:11 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Deleted allocations for instance eea1149f-7553-4beb-b8df-87822bd3abd5
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Cannot resize image /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Ensure instance console log exists: /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "eea1149f-7553-4beb-b8df-87822bd3abd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Successfully updated port: 486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "refresh_cache-038840e0-306b-466b-8dea-75d8cf2ea261" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquired lock "refresh_cache-038840e0-306b-466b-8dea-75d8cf2ea261" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:57:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-changed-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Refreshing instance network info cache due to event network-changed-486a31d1-881b-4b3c-882d-1baba88d88c2. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Acquiring lock "refresh_cache-038840e0-306b-466b-8dea-75d8cf2ea261" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Updating instance_info_cache with network_info: [{"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Releasing lock "refresh_cache-038840e0-306b-466b-8dea-75d8cf2ea261" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Instance network_info: |[{"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Acquired lock "refresh_cache-038840e0-306b-466b-8dea-75d8cf2ea261" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.neutron [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Refreshing network info cache for port 486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Start _get_guest_xml network_info=[{"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:57:12 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:57:12 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-148133998',display_name='tempest-VolumesNegativeTest-instance-148133998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-148133998',id=40,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be34184767f4a7b8ebc4754702407d8',ramdisk_id='',reservation_id='r-swjjtzjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1469243564',owner_user_name='tempest-VolumesNegativeTest-1469243564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:57:11Z,user_data=None,user_id='97c40e11f74d48798534d16ef676529f',uuid=038840e0-306b-466b-8dea-75d8cf2ea261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Converting VIF {"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lazy-loading 'pci_devices' on Instance uuid 038840e0-306b-466b-8dea-75d8cf2ea261 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:57:12 user nova-compute[74870]:   <uuid>038840e0-306b-466b-8dea-75d8cf2ea261</uuid>
Nov 28 06:57:12 user nova-compute[74870]:   <name>instance-00000028</name>
Nov 28 06:57:12 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:57:12 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:57:12 user nova-compute[74870]:   <metadata>
Nov 28 06:57:12 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:57:12 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:57:12 user nova-compute[74870]:       <nova:name>tempest-VolumesNegativeTest-instance-148133998</nova:name>
Nov 28 06:57:12 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:57:12</nova:creationTime>
Nov 28 06:57:12 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:57:12 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:57:12 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:57:12 user nova-compute[74870]:       <nova:owner>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:user uuid="97c40e11f74d48798534d16ef676529f">tempest-VolumesNegativeTest-1469243564-project-member</nova:user>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:project uuid="5be34184767f4a7b8ebc4754702407d8">tempest-VolumesNegativeTest-1469243564</nova:project>
Nov 28 06:57:12 user nova-compute[74870]:       </nova:owner>
Nov 28 06:57:12 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:57:12 user nova-compute[74870]:       <nova:ports>
Nov 28 06:57:12 user nova-compute[74870]:         <nova:port uuid="486a31d1-881b-4b3c-882d-1baba88d88c2">
Nov 28 06:57:12 user nova-compute[74870]:           <nova:ip type="fixed" address="192.168.233.222" ipVersion="4"/>
Nov 28 06:57:12 user nova-compute[74870]:         </nova:port>
Nov 28 06:57:12 user nova-compute[74870]:       </nova:ports>
Nov 28 06:57:12 user nova-compute[74870]:     </nova:instance>
Nov 28 06:57:12 user nova-compute[74870]:   </metadata>
Nov 28 06:57:12 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:57:12 user nova-compute[74870]:     <system>
Nov 28 06:57:12 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:57:12 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:57:12 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:57:12 user nova-compute[74870]:       <entry name="serial">038840e0-306b-466b-8dea-75d8cf2ea261</entry>
Nov 28 06:57:12 user nova-compute[74870]:       <entry name="uuid">038840e0-306b-466b-8dea-75d8cf2ea261</entry>
Nov 28 06:57:12 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:57:12 user nova-compute[74870]:     </system>
Nov 28 06:57:12 user nova-compute[74870]:   </sysinfo>
Nov 28 06:57:12 user nova-compute[74870]:   <os>
Nov 28 06:57:12 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:57:12 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:57:12 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:57:12 user nova-compute[74870]:   </os>
Nov 28 06:57:12 user nova-compute[74870]:   <features>
Nov 28 06:57:12 user nova-compute[74870]:     <acpi/>
Nov 28 06:57:12 user nova-compute[74870]:     <apic/>
Nov 28 06:57:12 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:57:12 user nova-compute[74870]:   </features>
Nov 28 06:57:12 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:57:12 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:57:12 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:57:12 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:57:12 user nova-compute[74870]:   </clock>
Nov 28 06:57:12 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:57:12 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:57:12 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:57:12 user nova-compute[74870]:   </cpu>
Nov 28 06:57:12 user nova-compute[74870]:   <devices>
Nov 28 06:57:12 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:57:12 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:57:12 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk"/>
Nov 28 06:57:12 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:57:12 user nova-compute[74870]:     </disk>
Nov 28 06:57:12 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:57:12 user nova-compute[74870]:       <mac address="fa:16:3e:0d:1c:ff"/>
Nov 28 06:57:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:57:12 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:57:12 user nova-compute[74870]:       <target dev="tap486a31d1-88"/>
Nov 28 06:57:12 user nova-compute[74870]:     </interface>
Nov 28 06:57:12 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:57:12 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/console.log" append="off"/>
Nov 28 06:57:12 user nova-compute[74870]:     </serial>
Nov 28 06:57:12 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:57:12 user nova-compute[74870]:     <video>
Nov 28 06:57:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:57:12 user nova-compute[74870]:     </video>
Nov 28 06:57:12 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:57:12 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:57:12 user nova-compute[74870]:     </rng>
Nov 28 06:57:12 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:57:12 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:57:12 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:57:12 user nova-compute[74870]:     </memballoon>
Nov 28 06:57:12 user nova-compute[74870]:   </devices>
Nov 28 06:57:12 user nova-compute[74870]: </domain>
Nov 28 06:57:12 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-148133998',display_name='tempest-VolumesNegativeTest-instance-148133998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-148133998',id=40,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be34184767f4a7b8ebc4754702407d8',ramdisk_id='',reservation_id='r-swjjtzjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1469243564',owner_user_name='tempest-VolumesNegativeTest-1469243564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:57:11Z,user_data=None,user_id='97c40e11f74d48798534d16ef676529f',uuid=038840e0-306b-466b-8dea-75d8cf2ea261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Converting VIF {"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG os_vif [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '066a20eb-aaab-5af9-884a-f8333114276a', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap486a31d1-88, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap486a31d1-88, col_values=(('qos', UUID('66d8075e-315e-4440-9855-9698d0cd8a00')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap486a31d1-88, col_values=(('external_ids', {'iface-id': '486a31d1-881b-4b3c-882d-1baba88d88c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:1c:ff', 'vm-uuid': '038840e0-306b-466b-8dea-75d8cf2ea261'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:12 user nova-compute[74870]: INFO os_vif [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88')
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] No VIF found with MAC fa:16:3e:0d:1c:ff, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.neutron [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Updated VIF entry in instance network info cache for port 486a31d1-881b-4b3c-882d-1baba88d88c2. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG nova.network.neutron [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Updating instance_info_cache with network_info: [{"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Releasing lock "refresh_cache-038840e0-306b-466b-8dea-75d8cf2ea261" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:57:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] No waiting events found dispatching network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:14 user nova-compute[74870]: WARNING nova.compute.manager [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received unexpected event network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 for instance with vm_state building and task_state spawning.
Nov 28 06:57:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:57:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Instance spawned successfully.
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:16 user nova-compute[74870]: INFO nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:57:16 user nova-compute[74870]: INFO nova.compute.manager [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Took 6.30 seconds to build instance.
Nov 28 06:57:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "038840e0-306b-466b-8dea-75d8cf2ea261" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.399s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] No waiting events found dispatching network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:16 user nova-compute[74870]: WARNING nova.compute.manager [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received unexpected event network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 for instance with vm_state active and task_state None.
Nov 28 06:57:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:57:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad is timed out.
Nov 28 06:57:26 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully detached device vdc from instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad from the live domain config.
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSUWObCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:57:26 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[652fdbc8-7a98-41ec-af05-065d7cdfc8bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:57:26 user nova-compute[74870]: No targets found.
Nov 28 06:57:26 user nova-compute[74870]: iSNS:
Nov 28 06:57:26 user nova-compute[74870]: No targets found.
Nov 28 06:57:26 user nova-compute[74870]: STATIC:
Nov 28 06:57:26 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:57:26 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:26 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:26 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf
Nov 28 06:57:26 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:26 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:26 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a
Nov 28 06:57:26 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:57:26 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:57:26 user nova-compute[74870]: FIRMWARE:
Nov 28 06:57:26 user nova-compute[74870]: No targets found.
Nov 28 06:57:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:57:26 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:57:26 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e7452-2a46-477b-add6-4cef1cba808a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:57:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=25.235591888427734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4edee30-ecb8-4f77-a42e-7f14c31fb2ff]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:57:26 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:57:26 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:57:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a (non-flash)
Nov 28 06:57:26 user nova-compute[74870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:57:26 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:57:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef4140820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be50338-d004-4421-b750-d951018cc137]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b01ab-6a18-49ae-a30f-d5da1585e9d3]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Applying migration context for instance edb101d9-028e-4191-84a2-1169555a21ad as it has an incoming, in-progress migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48. Migration status is finished {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 06:57:26 user nova-compute[74870]: INFO nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating resource usage from migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a67f24-c839-490a-818f-3ab63d4975dc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0b630563-12cc-467d-8908-e2a8fb230b62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance af3a583a-f470-4959-8515-1b1ddfe471c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 038840e0-306b-466b-8dea-75d8cf2ea261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9344cd-da22-4ae9-ada0-56b4723e18ed]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46303b40-2ba0-490f-ba1b-c4a4cc765c39]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ee7aa-28ff-4b1f-8342-bd4c0b01091a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260]
Nov 28 06:57:26 user nova-compute[74870]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a, portal: 172.16.0.220,3260] successful.
Nov 28 06:57:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1afd034-1bbc-43d2-8928-4c42295bcc8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b90ddf-84b1-4809-9e13-147577704fe4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.708s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] <== disconnect_volume: return (709ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG nova.objects.instance [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'flavor' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.328s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:57:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:57:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:57:30 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:57:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:57:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:57:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:57:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:57:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:57:42 user nova-compute[74870]: INFO nova.compute.claims [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Claim successful on node user
Nov 28 06:57:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:57:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:57:42 user nova-compute[74870]: DEBUG nova.policy [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:57:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Creating image(s)
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "/opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "/opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "/opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk 1073741824" returned: 0 in 0.054s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Successfully created port: e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.207s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Cannot resize image /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Ensure instance console log exists: /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Successfully updated port: e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquired lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-changed-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Refreshing instance network info cache due to event network-changed-e801ef0c-430d-49ef-8691-ef7c7678c8c5. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Acquiring lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updating instance_info_cache with network_info: [{"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Releasing lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Instance network_info: |[{"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Acquired lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.neutron [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Refreshing network info cache for port e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Start _get_guest_xml network_info=[{"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:57:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:57:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1110125265',display_name='tempest-VolumesSnapshotTestJSON-instance-1110125265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1110125265',id=41,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTeezUJfCy/PdT+5o55bBNniwqT/C6qqK5jybin9WqPIXvk//VYsW599FvWs1SqmYte1wj8MgqbzNjVg0sbpCKLN+EFeGh1OIohCgRfN10CZaS+lJIKEf4/u7bdxWEOVA==',key_name='tempest-keypair-536756227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82be9b17ed614b8aa2bb7172eedf516e',ramdisk_id='',reservation_id='r-g02qhrnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-719548845',owner_user_name='tempest-VolumesSnapshotTestJSON-719548845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:57:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eb76cab93f4dfd97bf85828d89df68',uuid=572ab6e9-7bbc-44ad-9e20-c53c17ed333f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converting VIF {"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.objects.instance [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'pci_devices' on Instance uuid 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:57:44 user nova-compute[74870]:   <uuid>572ab6e9-7bbc-44ad-9e20-c53c17ed333f</uuid>
Nov 28 06:57:44 user nova-compute[74870]:   <name>instance-00000029</name>
Nov 28 06:57:44 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:57:44 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:57:44 user nova-compute[74870]:   <metadata>
Nov 28 06:57:44 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:57:44 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:57:44 user nova-compute[74870]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1110125265</nova:name>
Nov 28 06:57:44 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:57:44</nova:creationTime>
Nov 28 06:57:44 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:57:44 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:57:44 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:57:44 user nova-compute[74870]:       <nova:owner>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:user uuid="37eb76cab93f4dfd97bf85828d89df68">tempest-VolumesSnapshotTestJSON-719548845-project-member</nova:user>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:project uuid="82be9b17ed614b8aa2bb7172eedf516e">tempest-VolumesSnapshotTestJSON-719548845</nova:project>
Nov 28 06:57:44 user nova-compute[74870]:       </nova:owner>
Nov 28 06:57:44 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:57:44 user nova-compute[74870]:       <nova:ports>
Nov 28 06:57:44 user nova-compute[74870]:         <nova:port uuid="e801ef0c-430d-49ef-8691-ef7c7678c8c5">
Nov 28 06:57:44 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 06:57:44 user nova-compute[74870]:         </nova:port>
Nov 28 06:57:44 user nova-compute[74870]:       </nova:ports>
Nov 28 06:57:44 user nova-compute[74870]:     </nova:instance>
Nov 28 06:57:44 user nova-compute[74870]:   </metadata>
Nov 28 06:57:44 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:57:44 user nova-compute[74870]:     <system>
Nov 28 06:57:44 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:57:44 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:57:44 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:57:44 user nova-compute[74870]:       <entry name="serial">572ab6e9-7bbc-44ad-9e20-c53c17ed333f</entry>
Nov 28 06:57:44 user nova-compute[74870]:       <entry name="uuid">572ab6e9-7bbc-44ad-9e20-c53c17ed333f</entry>
Nov 28 06:57:44 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:57:44 user nova-compute[74870]:     </system>
Nov 28 06:57:44 user nova-compute[74870]:   </sysinfo>
Nov 28 06:57:44 user nova-compute[74870]:   <os>
Nov 28 06:57:44 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:57:44 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:57:44 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:57:44 user nova-compute[74870]:   </os>
Nov 28 06:57:44 user nova-compute[74870]:   <features>
Nov 28 06:57:44 user nova-compute[74870]:     <acpi/>
Nov 28 06:57:44 user nova-compute[74870]:     <apic/>
Nov 28 06:57:44 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:57:44 user nova-compute[74870]:   </features>
Nov 28 06:57:44 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:57:44 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:57:44 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:57:44 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:57:44 user nova-compute[74870]:   </clock>
Nov 28 06:57:44 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:57:44 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:57:44 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:57:44 user nova-compute[74870]:   </cpu>
Nov 28 06:57:44 user nova-compute[74870]:   <devices>
Nov 28 06:57:44 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:57:44 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:57:44 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk"/>
Nov 28 06:57:44 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:57:44 user nova-compute[74870]:     </disk>
Nov 28 06:57:44 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:57:44 user nova-compute[74870]:       <mac address="fa:16:3e:e5:65:38"/>
Nov 28 06:57:44 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:57:44 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:57:44 user nova-compute[74870]:       <target dev="tape801ef0c-43"/>
Nov 28 06:57:44 user nova-compute[74870]:     </interface>
Nov 28 06:57:44 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:57:44 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/console.log" append="off"/>
Nov 28 06:57:44 user nova-compute[74870]:     </serial>
Nov 28 06:57:44 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:57:44 user nova-compute[74870]:     <video>
Nov 28 06:57:44 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:57:44 user nova-compute[74870]:     </video>
Nov 28 06:57:44 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:57:44 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:57:44 user nova-compute[74870]:     </rng>
Nov 28 06:57:44 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:57:44 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:57:44 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:57:44 user nova-compute[74870]:     </memballoon>
Nov 28 06:57:44 user nova-compute[74870]:   </devices>
Nov 28 06:57:44 user nova-compute[74870]: </domain>
Nov 28 06:57:44 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1110125265',display_name='tempest-VolumesSnapshotTestJSON-instance-1110125265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1110125265',id=41,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTeezUJfCy/PdT+5o55bBNniwqT/C6qqK5jybin9WqPIXvk//VYsW599FvWs1SqmYte1wj8MgqbzNjVg0sbpCKLN+EFeGh1OIohCgRfN10CZaS+lJIKEf4/u7bdxWEOVA==',key_name='tempest-keypair-536756227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82be9b17ed614b8aa2bb7172eedf516e',ramdisk_id='',reservation_id='r-g02qhrnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-719548845',owner_user_name='tempest-VolumesSnapshotTestJSON-719548845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:57:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eb76cab93f4dfd97bf85828d89df68',uuid=572ab6e9-7bbc-44ad-9e20-c53c17ed333f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converting VIF {"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG os_vif [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1760c45a-9c6a-582f-82d0-97e95bb599f7', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape801ef0c-43, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape801ef0c-43, col_values=(('qos', UUID('4f4fce74-3e7e-45ea-8650-ff135deda6e3')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape801ef0c-43, col_values=(('external_ids', {'iface-id': 'e801ef0c-430d-49ef-8691-ef7c7678c8c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:65:38', 'vm-uuid': '572ab6e9-7bbc-44ad-9e20-c53c17ed333f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:44 user nova-compute[74870]: INFO os_vif [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43')
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:57:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No VIF found with MAC fa:16:3e:e5:65:38, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:57:45 user nova-compute[74870]: DEBUG nova.network.neutron [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updated VIF entry in instance network info cache for port e801ef0c-430d-49ef-8691-ef7c7678c8c5. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:57:45 user nova-compute[74870]: DEBUG nova.network.neutron [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updating instance_info_cache with network_info: [{"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Releasing lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] No waiting events found dispatching network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:46 user nova-compute[74870]: WARNING nova.compute.manager [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received unexpected event network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance with vm_state building and task_state spawning.
Nov 28 06:57:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:57:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Instance spawned successfully.
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:57:48 user nova-compute[74870]: INFO nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] No waiting events found dispatching network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:48 user nova-compute[74870]: WARNING nova.compute.manager [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received unexpected event network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance with vm_state building and task_state spawning.
Nov 28 06:57:48 user nova-compute[74870]: INFO nova.compute.manager [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Took 6.18 seconds to build instance.
Nov 28 06:57:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.284s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 06:57:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:57:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 06:57:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Going to confirm migration 2 {{(pid=74870) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:56 user nova-compute[74870]: INFO nova.compute.manager [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Terminating instance
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'info_cache' on Instance uuid edb101d9-028e-4191-84a2-1169555a21ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Instance destroyed successfully.
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'resources' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-161739875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-161739875',id=34,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgppLb2kNYG5hyeE0SEPq0PFajgXAsCK1knJv+jOVeGkDLsXyFItKhJE8Nomj2oA0/dnErgSFuw7MdhLob2xlyJnLrkin+BS1Fq0CIEv5UHpjZO84gELSv312s7eJMXCA==',key_name='tempest-keypair-259314972',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-x7x4oe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=4fe14a8c-afa2-43b4-a885-914f4c8195ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "fc037856-716e-436b-b551-55cd7f2497cc", "address": "fa:16:3e:6b:86:96", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc037856-71", "ovs_interfaceid": "fc037856-716e-436b-b551-55cd7f2497cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG os_vif [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc037856-71, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d032c40f-80f1-4120-b42e-1ce5176b6c6f) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:56 user nova-compute[74870]: INFO os_vif [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:86:96,bridge_name='br-int',has_traffic_filtering=True,id=fc037856-716e-436b-b551-55cd7f2497cc,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc037856-71')
Nov 28 06:57:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Deleting instance files /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad_del
Nov 28 06:57:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Deletion of /opt/stack/data/nova/instances/4fe14a8c-afa2-43b4-a885-914f4c8195ad_del complete
Nov 28 06:57:56 user nova-compute[74870]: INFO nova.compute.manager [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 06:57:56 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:57:56 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG nova.network.neutron [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG nova.objects.instance [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'migration_context' on Instance uuid edb101d9-028e-4191-84a2-1169555a21ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG nova.objects.base [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Object Instance<edb101d9-028e-4191-84a2-1169555a21ad> lazy-loaded attributes: info_cache,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:57:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.369s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:57 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Deleted allocation for migration 1756b7a2-95b0-4ec9-a8c4-9f2264e7bb48
Nov 28 06:57:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.930s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:57:58 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Took 1.11 seconds to deallocate network for instance.
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:58 user nova-compute[74870]: WARNING nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state deleted and task_state None.
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:58 user nova-compute[74870]: WARNING nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state deleted and task_state None.
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:58 user nova-compute[74870]: WARNING nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state deleted and task_state None.
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:58 user nova-compute[74870]: WARNING nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-unplugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state deleted and task_state None.
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Acquiring lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] No waiting events found dispatching network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:57:58 user nova-compute[74870]: WARNING nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received unexpected event network-vif-plugged-fc037856-716e-436b-b551-55cd7f2497cc for instance with vm_state deleted and task_state None.
Nov 28 06:57:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Received event network-vif-deleted-fc037856-716e-436b-b551-55cd7f2497cc {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:58 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Deleted allocations for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad
Nov 28 06:57:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "4fe14a8c-afa2-43b4-a885-914f4c8195ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.571s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:57:59 user nova-compute[74870]: INFO nova.compute.manager [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Terminating instance
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Instance destroyed successfully.
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'resources' on Instance uuid 0b630563-12cc-467d-8908-e2a8fb230b62 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1355811946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1355811946',id=4,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07e9312175c4e73aa29a51865d61ebd',ramdisk_id='',reservation_id='r-rdbjf6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-397751332',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:40:15Z,user_data=None,user_id='c13b793a926942e88fc3416cf3fa005e',uuid=0b630563-12cc-467d-8908-e2a8fb230b62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converting VIF {"id": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "address": "fa:16:3e:45:8b:13", "network": {"id": "7bc73412-fe34-4d8c-85c8-4cc726512d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1574915355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07e9312175c4e73aa29a51865d61ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14d8817-78", "ovs_interfaceid": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG os_vif [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf14d8817-78, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88a832fb-61b3-4978-98d2-ccbd6656840a) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:57:59 user nova-compute[74870]: INFO os_vif [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:8b:13,bridge_name='br-int',has_traffic_filtering=True,id=f14d8817-78b1-4d77-b312-3d5ccaab9d4a,network=Network(7bc73412-fe34-4d8c-85c8-4cc726512d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14d8817-78')
Nov 28 06:57:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Deleting instance files /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62_del
Nov 28 06:57:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Deletion of /opt/stack/data/nova/instances/0b630563-12cc-467d-8908-e2a8fb230b62_del complete
Nov 28 06:57:59 user nova-compute[74870]: INFO nova.compute.manager [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 28 06:57:59 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:57:59 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-vif-unplugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] No waiting events found dispatching network-vif-unplugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-vif-unplugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Acquiring lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Lock "0b630563-12cc-467d-8908-e2a8fb230b62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] No waiting events found dispatching network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:58:00 user nova-compute[74870]: WARNING nova.compute.manager [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received unexpected event network-vif-plugged-f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance with vm_state active and task_state deleting.
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:58:00 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Took 0.74 seconds to deallocate network for instance.
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:00 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Deleted allocations for instance 0b630563-12cc-467d-8908-e2a8fb230b62
Nov 28 06:58:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "0b630563-12cc-467d-8908-e2a8fb230b62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Received event network-vif-deleted-f14d8817-78b1-4d77-b312-3d5ccaab9d4a {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-changed-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG nova.compute.manager [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Refreshing instance network info cache due to event network-changed-97da79b7-c41c-46da-8faa-03d072c630a6. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Acquiring lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Acquired lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Refreshing network info cache for port 97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updated VIF entry in instance network info cache for port 97da79b7-c41c-46da-8faa-03d072c630a6. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updating instance_info_cache with network_info: [{"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:58:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Releasing lock "refresh_cache-92e60471-f6da-476c-b0de-c729eec1b2b4" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:16 user nova-compute[74870]: INFO nova.compute.manager [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Terminating instance
Nov 28 06:58:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Instance destroyed successfully.
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.objects.instance [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'resources' on Instance uuid af3a583a-f470-4959-8515-1b1ddfe471c0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1819608978',display_name='tempest-TestVolumeBootPattern-server-1819608978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1819608978',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:56:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-hxfns764',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:56:50Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=af3a583a-f470-4959-8515-1b1ddfe471c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "address": "fa:16:3e:10:58:58", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d293fb-d7", "ovs_interfaceid": "75d293fb-d78b-480f-a0a9-0f98b3d606e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_vif [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75d293fb-d7, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e4538e8-3fbc-4b41-aa12-74941fd8abb6) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:17 user nova-compute[74870]: INFO os_vif [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:58:58,bridge_name='br-int',has_traffic_filtering=True,id=75d293fb-d78b-480f-a0a9-0f98b3d606e7,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d293fb-d7')
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdYmiWLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:58:17 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b19a01-9b50-4e53-b1a3-ade62615ff62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:58:17 user nova-compute[74870]: No targets found.
Nov 28 06:58:17 user nova-compute[74870]: iSNS:
Nov 28 06:58:17 user nova-compute[74870]: No targets found.
Nov 28 06:58:17 user nova-compute[74870]: STATIC:
Nov 28 06:58:17 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:58:17 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:58:17 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:58:17 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf
Nov 28 06:58:17 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:58:17 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:58:17 user nova-compute[74870]: FIRMWARE:
Nov 28 06:58:17 user nova-compute[74870]: No targets found.
Nov 28 06:58:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:58:17 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:58:17 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[774317a7-7113-4c10-abf2-147044f2e464]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97517f6c-6e8d-48f2-938e-5fc983741a03]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:17 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:58:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:17 user nova-compute[74870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf (non-flash)
Nov 28 06:58:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc127490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf'): ({'sde'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Removing single pathed devices sde {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad73bd-7c41-4e68-a6b6-246f8824b529]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920592c-a7e8-4cb2-b0ab-b099db68b5b6]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flushing IO for device /dev/sde {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[436dc003-4f0a-43e3-b843-40fd375500df]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.065s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed384b5b-1619-48ff-b2e7-fd9203f8bcc8]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] SCSI volumes sde have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-vif-unplugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] No waiting events found dispatching network-vif-unplugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-vif-unplugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Acquiring lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] No waiting events found dispatching network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:58:17 user nova-compute[74870]: WARNING nova.compute.manager [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received unexpected event network-vif-plugged-75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance with vm_state active and task_state deleting.
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.079s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[184deb0c-350f-4691-a83d-3f78770310cc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[57efbd2e-14f0-4f84-97fa-b40f3b9b9149]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260]
Nov 28 06:58:17 user nova-compute[74870]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf, portal: 172.16.0.220,3260] successful.
Nov 28 06:58:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:071d34bb-0a10-4713-9fe1-c232ea56facf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6957d075-5e47-4a69-b597-c7c0bae3e4fd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== disconnect_volume: return (385ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:58:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Deleting instance files /opt/stack/data/nova/instances/af3a583a-f470-4959-8515-1b1ddfe471c0_del
Nov 28 06:58:17 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Deletion of /opt/stack/data/nova/instances/af3a583a-f470-4959-8515-1b1ddfe471c0_del complete
Nov 28 06:58:17 user nova-compute[74870]: INFO nova.compute.manager [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 28 06:58:17 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:58:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:58:17 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Took 0.37 seconds to deallocate network for instance.
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:18 user nova-compute[74870]: INFO nova.compute.manager [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attaching volume 80544c11-3c17-4319-8489-8c4e24a58fe7 to /dev/vdb
Nov 28 06:58:18 user nova-compute[74870]: DEBUG os_brick.utils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4040ef9-73e0-4164-9a6f-a8fac44d44b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[546fb1d3-8d16-4c67-a80c-4ca744384b26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b226d6-a30e-475f-a26d-4af9bd812670]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba1e9d-f8c8-4ce2-9e6b-87d95cc3ac34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:58:18 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abbfb6f-e54f-4266-9bb4-3b425535a14f]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG os_brick.utils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updating existing volume attachment record: f5709684-d076-429b-a80e-50bf8a48fd37 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:58:18 user nova-compute[74870]: INFO nova.compute.manager [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Took 0.95 seconds to detach 1 volumes for instance.
Nov 28 06:58:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Deleting volume: 071d34bb-0a10-4713-9fe1-c232ea56facf {{(pid=74870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:19 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:58:19 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:58:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:19 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Deleted allocations for instance af3a583a-f470-4959-8515-1b1ddfe471c0
Nov 28 06:58:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "af3a583a-f470-4959-8515-1b1ddfe471c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.079s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:19 user nova-compute[74870]: DEBUG nova.compute.manager [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Received event network-vif-deleted-75d293fb-d78b-480f-a0a9-0f98b3d606e7 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsMIVNYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:58:25 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:58:25 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:58:25 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec4be18-d85e-44b2-acb2-e618408740ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:58:25 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc9b1fa-4768-4ee1-9cb3-1f38d906484e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7] added
Nov 28 06:58:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd6508-6f8c-4163-b6dc-20cb7014d788]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e131d0d-001e-4b4e-bc55-d989020f73d9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsMIVNYt {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsMIVNYt" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7131f8-d5cc-4ba3-971d-f43c3341a4e8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GsMIVNYt'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b91542-7e38-44d5-9673-5825f7d927d1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[821fbd53-420b-4284-8810-f02615186581]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f7e5a-f683-4a68-9fb3-924e8f32345c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260]
Nov 28 06:58:25 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260] successful.
Nov 28 06:58:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[98597d6d-ab5f-462a-8d8e-53e22a5c2894]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d2ca1c-c6ce-4230-84a5-62ae9d793a3f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:25 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:58:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:25 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:58:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c45d9-6f22-43d4-ac33-8137cedd8b15]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsMIVNYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23039333136393230', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039333136393230', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:58:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:58:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.321857452392578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:58:27 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:58:27 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:58:27 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:58:27 user nova-compute[74870]:   <serial>80544c11-3c17-4319-8489-8c4e24a58fe7</serial>
Nov 28 06:58:27 user nova-compute[74870]: </disk>
Nov 28 06:58:27 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 038840e0-306b-466b-8dea-75d8cf2ea261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No VIF found with MAC fa:16:3e:27:6d:c1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:58:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.213s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:58:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:31 user nova-compute[74870]: INFO nova.compute.manager [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attaching volume de5af4b7-5758-4a72-bf9f-738feb2c01c8 to /dev/vdc
Nov 28 06:58:31 user nova-compute[74870]: DEBUG os_brick.utils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5145595-6bf0-4338-bcc5-1d95cd2790d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f5430d-dd64-44e5-9996-795f6dac88c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718bb20-a53f-4184-9201-f29faaaa04b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea1028-e5be-44da-8738-547b996a851b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:58:31 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc4f128-a69e-418c-a9ca-44823f0030d5]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG os_brick.utils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updating existing volume attachment record: 343344f4-61bd-464b-9bec-4929e9e31d24 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [{"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-edb101d9-028e-4191-84a2-1169555a21ad" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:58:31 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 06:58:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:58:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qENiRLPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:58:37 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:58:37 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:58:37 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d519a665-ccdf-4446-ab92-b1e31705f848]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:58:37 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cf8714-f897-493f-8df9-e7baf4e6de05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8] added
Nov 28 06:58:37 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f77e63-995d-4632-ba95-1936c2e6e8a9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[246f23e0-7f70-4866-bb87-f11810520689]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qENiRLPG {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qENiRLPG" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[009cf741-cbc5-4b23-bdb7-52f3187a8829]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qENiRLPG'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab11414-e115-476f-b035-ff85566bdf16]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e90845-db02-4e9b-81c7-3941b6d031a5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcfae66-f45e-41b9-9de2-24015ab8c69e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260]
Nov 28 06:58:38 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260] successful.
Nov 28 06:58:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa070b-c8b7-4339-9cc0-c3ab45c33a70]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43694ec-cd39-451b-9f03-cc352af9d124]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)
Nov 28 06:58:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[01909052-0bef-4c1a-9583-592e1f748b88]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:58:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qENiRLPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26535386565653033', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386565653033', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:58:39 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:58:39 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 06:58:39 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:58:39 user nova-compute[74870]:   <serial>de5af4b7-5758-4a72-bf9f-738feb2c01c8</serial>
Nov 28 06:58:39 user nova-compute[74870]: </disk>
Nov 28 06:58:39 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] No VIF found with MAC fa:16:3e:27:6d:c1, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:58:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.648s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:41 user nova-compute[74870]: INFO nova.compute.manager [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Detaching volume 80544c11-3c17-4319-8489-8c4e24a58fe7
Nov 28 06:58:41 user nova-compute[74870]: INFO nova.virt.block_device [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attempting to driver detach volume 80544c11-3c17-4319-8489-8c4e24a58fe7 from mountpoint /dev/vdb
Nov 28 06:58:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Attempting to detach device vdb from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:58:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:58:41 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:58:41 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:58:41 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:58:41 user nova-compute[74870]:   <serial>80544c11-3c17-4319-8489-8c4e24a58fe7</serial>
Nov 28 06:58:41 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:58:41 user nova-compute[74870]: </disk>
Nov 28 06:58:41 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:58:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully detached device vdb from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the persistent domain config.
Nov 28 06:58:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:58:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:58:41 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:58:41 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 06:58:41 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:58:41 user nova-compute[74870]:   <serial>80544c11-3c17-4319-8489-8c4e24a58fe7</serial>
Nov 28 06:58:41 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 06:58:41 user nova-compute[74870]: </disk>
Nov 28 06:58:41 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:58:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:58:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:58:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:58:50 user nova-compute[74870]: INFO nova.compute.claims [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Claim successful on node user
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:58:50 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.policy [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:58:50 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Creating image(s)
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk 1073741824" returned: 0 in 0.052s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Successfully created port: b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Cannot resize image /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Ensure instance console log exists: /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Successfully updated port: b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing instance network info cache due to event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:58:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance network_info: |[{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Start _get_guest_xml network_info=[{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:58:52 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:58:52 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1985880305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1985880305',id=42,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPwnK6lmjMoJybvl5cVU2MnwVHXFMNeaO8Rsnt98BjuMQVUOleaBJRxeVYQX7a8iMW/3nZ6jmfwOilHW6nIAGbi0+22NgwmT8lUhLxagB/l+ms7V0NW840WRlnEpKPZA==',key_name='tempest-keypair-1691834733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-0tb0vdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=57d4327e-1732-4e71-be0d-05ae08e312b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.objects.instance [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'pci_devices' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:58:52 user nova-compute[74870]:   <uuid>57d4327e-1732-4e71-be0d-05ae08e312b5</uuid>
Nov 28 06:58:52 user nova-compute[74870]:   <name>instance-0000002a</name>
Nov 28 06:58:52 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:58:52 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:58:52 user nova-compute[74870]:   <metadata>
Nov 28 06:58:52 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:58:52 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:58:52 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1985880305</nova:name>
Nov 28 06:58:52 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:58:52</nova:creationTime>
Nov 28 06:58:52 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:58:52 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:58:52 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:58:52 user nova-compute[74870]:       <nova:owner>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:user uuid="dbf659ad4b8f43a2bc497d01be58d846">tempest-AttachVolumeShelveTestJSON-92318211-project-member</nova:user>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:project uuid="9d769a1c976c468f804770d89c92ae94">tempest-AttachVolumeShelveTestJSON-92318211</nova:project>
Nov 28 06:58:52 user nova-compute[74870]:       </nova:owner>
Nov 28 06:58:52 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 06:58:52 user nova-compute[74870]:       <nova:ports>
Nov 28 06:58:52 user nova-compute[74870]:         <nova:port uuid="b8282f0c-783f-4279-b530-d188e9b43e49">
Nov 28 06:58:52 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 06:58:52 user nova-compute[74870]:         </nova:port>
Nov 28 06:58:52 user nova-compute[74870]:       </nova:ports>
Nov 28 06:58:52 user nova-compute[74870]:     </nova:instance>
Nov 28 06:58:52 user nova-compute[74870]:   </metadata>
Nov 28 06:58:52 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:58:52 user nova-compute[74870]:     <system>
Nov 28 06:58:52 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:58:52 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:58:52 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:58:52 user nova-compute[74870]:       <entry name="serial">57d4327e-1732-4e71-be0d-05ae08e312b5</entry>
Nov 28 06:58:52 user nova-compute[74870]:       <entry name="uuid">57d4327e-1732-4e71-be0d-05ae08e312b5</entry>
Nov 28 06:58:52 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:58:52 user nova-compute[74870]:     </system>
Nov 28 06:58:52 user nova-compute[74870]:   </sysinfo>
Nov 28 06:58:52 user nova-compute[74870]:   <os>
Nov 28 06:58:52 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:58:52 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:58:52 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:58:52 user nova-compute[74870]:   </os>
Nov 28 06:58:52 user nova-compute[74870]:   <features>
Nov 28 06:58:52 user nova-compute[74870]:     <acpi/>
Nov 28 06:58:52 user nova-compute[74870]:     <apic/>
Nov 28 06:58:52 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:58:52 user nova-compute[74870]:   </features>
Nov 28 06:58:52 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:58:52 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:58:52 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:58:52 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:58:52 user nova-compute[74870]:   </clock>
Nov 28 06:58:52 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:58:52 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:58:52 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:58:52 user nova-compute[74870]:   </cpu>
Nov 28 06:58:52 user nova-compute[74870]:   <devices>
Nov 28 06:58:52 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 06:58:52 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 06:58:52 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk"/>
Nov 28 06:58:52 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:58:52 user nova-compute[74870]:     </disk>
Nov 28 06:58:52 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:58:52 user nova-compute[74870]:       <mac address="fa:16:3e:b6:2b:ed"/>
Nov 28 06:58:52 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:58:52 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:58:52 user nova-compute[74870]:       <target dev="tapb8282f0c-78"/>
Nov 28 06:58:52 user nova-compute[74870]:     </interface>
Nov 28 06:58:52 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:58:52 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/console.log" append="off"/>
Nov 28 06:58:52 user nova-compute[74870]:     </serial>
Nov 28 06:58:52 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:58:52 user nova-compute[74870]:     <video>
Nov 28 06:58:52 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:58:52 user nova-compute[74870]:     </video>
Nov 28 06:58:52 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:58:52 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:58:52 user nova-compute[74870]:     </rng>
Nov 28 06:58:52 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:58:52 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:58:52 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:58:52 user nova-compute[74870]:     </memballoon>
Nov 28 06:58:52 user nova-compute[74870]:   </devices>
Nov 28 06:58:52 user nova-compute[74870]: </domain>
Nov 28 06:58:52 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1985880305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1985880305',id=42,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPwnK6lmjMoJybvl5cVU2MnwVHXFMNeaO8Rsnt98BjuMQVUOleaBJRxeVYQX7a8iMW/3nZ6jmfwOilHW6nIAGbi0+22NgwmT8lUhLxagB/l+ms7V0NW840WRlnEpKPZA==',key_name='tempest-keypair-1691834733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-0tb0vdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=57d4327e-1732-4e71-be0d-05ae08e312b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG os_vif [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf86bdf1-5ea3-5a89-a324-6ad6f95c0118', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8282f0c-78, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8282f0c-78, col_values=(('qos', UUID('47959a36-cda7-43bd-87e1-27581ec72255')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8282f0c-78, col_values=(('external_ids', {'iface-id': 'b8282f0c-783f-4279-b530-d188e9b43e49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:2b:ed', 'vm-uuid': '57d4327e-1732-4e71-be0d-05ae08e312b5'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:52 user nova-compute[74870]: INFO os_vif [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78')
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No VIF found with MAC fa:16:3e:b6:2b:ed, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updated VIF entry in instance network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:58:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:53 user nova-compute[74870]: DEBUG nova.compute.manager [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:58:53 user nova-compute[74870]: WARNING nova.compute.manager [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state building and task_state spawning.
Nov 28 06:58:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:58:56 user nova-compute[74870]: WARNING nova.compute.manager [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state building and task_state spawning.
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:58:56 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance spawned successfully.
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:58:56 user nova-compute[74870]: INFO nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 28 06:58:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:58:56 user nova-compute[74870]: INFO nova.compute.manager [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Took 6.11 seconds to build instance.
Nov 28 06:58:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.211s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:58:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:58:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "038840e0-306b-466b-8dea-75d8cf2ea261" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:00 user nova-compute[74870]: INFO nova.compute.manager [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Terminating instance
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-vif-unplugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] No waiting events found dispatching network-vif-unplugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-vif-unplugged-486a31d1-881b-4b3c-882d-1baba88d88c2 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:59:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Instance destroyed successfully.
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lazy-loading 'resources' on Instance uuid 038840e0-306b-466b-8dea-75d8cf2ea261 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-148133998',display_name='tempest-VolumesNegativeTest-instance-148133998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-148133998',id=40,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:57:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be34184767f4a7b8ebc4754702407d8',ramdisk_id='',reservation_id='r-swjjtzjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1469243564',owner_user_name='tempest-VolumesNegativeTest-1469243564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:57:16Z,user_data=None,user_id='97c40e11f74d48798534d16ef676529f',uuid=038840e0-306b-466b-8dea-75d8cf2ea261,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Converting VIF {"id": "486a31d1-881b-4b3c-882d-1baba88d88c2", "address": "fa:16:3e:0d:1c:ff", "network": {"id": "4fe9d185-2124-4615-9964-91783a9dd14d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eeb6ee6e11b14c2eb40a470bed25b76d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486a31d1-88", "ovs_interfaceid": "486a31d1-881b-4b3c-882d-1baba88d88c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG os_vif [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap486a31d1-88, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66d8075e-315e-4440-9855-9698d0cd8a00) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:59:00 user nova-compute[74870]: INFO os_vif [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:1c:ff,bridge_name='br-int',has_traffic_filtering=True,id=486a31d1-881b-4b3c-882d-1baba88d88c2,network=Network(4fe9d185-2124-4615-9964-91783a9dd14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486a31d1-88')
Nov 28 06:59:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Deleting instance files /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261_del
Nov 28 06:59:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Deletion of /opt/stack/data/nova/instances/038840e0-306b-466b-8dea-75d8cf2ea261_del complete
Nov 28 06:59:00 user nova-compute[74870]: INFO nova.compute.manager [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 28 06:59:00 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:59:00 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:59:01 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Took 0.75 seconds to deallocate network for instance.
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-vif-deleted-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:01 user nova-compute[74870]: INFO nova.compute.manager [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Neutron deleted interface 486a31d1-881b-4b3c-882d-1baba88d88c2; detaching it from the instance and deleting it from the info cache
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.network.neutron [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.compute.manager [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Detach interface failed, port_id=486a31d1-881b-4b3c-882d-1baba88d88c2, reason: Instance 038840e0-306b-466b-8dea-75d8cf2ea261 could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:01 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Deleted allocations for instance 038840e0-306b-466b-8dea-75d8cf2ea261
Nov 28 06:59:01 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 is timed out.
Nov 28 06:59:01 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully detached device vdb from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the live domain config.
Nov 28 06:59:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsMIVNYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:59:01 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf82c109-d455-440b-a06d-15df4de5a9f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:59:01 user nova-compute[74870]: No targets found.
Nov 28 06:59:01 user nova-compute[74870]: iSNS:
Nov 28 06:59:01 user nova-compute[74870]: No targets found.
Nov 28 06:59:01 user nova-compute[74870]: STATIC:
Nov 28 06:59:01 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:59:01 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:59:01 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:59:01 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7
Nov 28 06:59:01 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:59:01 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:59:01 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8
Nov 28 06:59:01 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:59:01 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:59:01 user nova-compute[74870]: FIRMWARE:
Nov 28 06:59:01 user nova-compute[74870]: No targets found.
Nov 28 06:59:01 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:59:01 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:59:01 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[58991786-6379-4716-95a9-04f61432b7cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "038840e0-306b-466b-8dea-75d8cf2ea261" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74975d0-ccdc-4766-bb61-e8271ae058ab]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:01 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:59:01 user nova-compute[74870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)
Nov 28 06:59:01 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:01 user nova-compute[74870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 (non-flash)
Nov 28 06:59:01 user nova-compute[74870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)
Nov 28 06:59:01 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc605a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50484142-f62b-4796-8a36-60571b99cb4a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c64bb-365f-46c8-8d23-4baf418dc6a2]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb73a08f-36d7-4c28-b494-54747ffb720a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddcf619-179b-4a07-a54e-1b90a6b59370]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[908e0f2a-f9e5-4a01-8035-c37ac1ff8ae8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ac0eaa-960f-404c-ab21-7b7cd2a19bf3]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260]
Nov 28 06:59:02 user nova-compute[74870]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7, portal: 172.16.0.220,3260] successful.
Nov 28 06:59:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80544c11-3c17-4319-8489-8c4e24a58fe7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[197bb04e-c41d-4b5a-afc6-ec0e6785248d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== disconnect_volume: return (321ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received event network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Acquiring lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Lock "038840e0-306b-466b-8dea-75d8cf2ea261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] No waiting events found dispatching network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:59:02 user nova-compute[74870]: WARNING nova.compute.manager [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Received unexpected event network-vif-plugged-486a31d1-881b-4b3c-882d-1baba88d88c2 for instance with vm_state deleted and task_state None.
Nov 28 06:59:03 user nova-compute[74870]: DEBUG nova.objects.instance [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.121s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:03 user nova-compute[74870]: INFO nova.compute.manager [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Detaching volume de5af4b7-5758-4a72-bf9f-738feb2c01c8
Nov 28 06:59:04 user nova-compute[74870]: INFO nova.virt.block_device [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Attempting to driver detach volume de5af4b7-5758-4a72-bf9f-738feb2c01c8 from mountpoint /dev/vdc
Nov 28 06:59:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Attempting to detach device vdc from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 06:59:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:59:04 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:59:04 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 06:59:04 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:59:04 user nova-compute[74870]:   <serial>de5af4b7-5758-4a72-bf9f-738feb2c01c8</serial>
Nov 28 06:59:04 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 06:59:04 user nova-compute[74870]: </disk>
Nov 28 06:59:04 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:59:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully detached device vdc from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the persistent domain config.
Nov 28 06:59:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 06:59:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 06:59:04 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:59:04 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 06:59:04 user nova-compute[74870]:   <target dev="vdc" bus="virtio"/>
Nov 28 06:59:04 user nova-compute[74870]:   <serial>de5af4b7-5758-4a72-bf9f-738feb2c01c8</serial>
Nov 28 06:59:04 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 06:59:04 user nova-compute[74870]: </disk>
Nov 28 06:59:04 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 06:59:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 06:59:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "304574e5-b806-44dc-9302-cdce2822898f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:20 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 06:59:20 user nova-compute[74870]: INFO nova.compute.claims [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Claim successful on node user
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 06:59:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.policy [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 06:59:21 user nova-compute[74870]: INFO nova.virt.block_device [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Booting with volume ed591127-ee7f-497d-9cfc-4cd2e691c235 at /dev/vda
Nov 28 06:59:21 user nova-compute[74870]: DEBUG os_brick.utils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247eef0-25ff-499c-a5ab-bba3d21448b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be32bd7-dd14-4694-8b70-55ab8dd0ad96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cbddae-30b3-4794-bd35-7e969337131e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6e53cb-807f-4726-af73-2189d6b3da18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:59:21 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:59:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab6ae54-3ddb-432a-b0b8-b8f05aebde71]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG os_brick.utils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:59:21 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating existing volume attachment record: dce78032-af26-4b78-a0ef-0a52c6d4c7b9 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Successfully created port: 3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Successfully updated port: 3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquired lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-changed-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Refreshing instance network info cache due to event network-changed-3eb0757a-68b5-4718-b270-812c217e9e86. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Acquiring lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:59:22 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating instance_info_cache with network_info: [{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Releasing lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Instance network_info: |[{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Acquired lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Refreshing network info cache for port 3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updated VIF entry in instance network info cache for port 3eb0757a-68b5-4718-b270-812c217e9e86. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating instance_info_cache with network_info: [{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:59:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Releasing lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:24 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 is timed out.
Nov 28 06:59:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:24 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully detached device vdc from instance 92e60471-f6da-476c-b0de-c729eec1b2b4 from the live domain config.
Nov 28 06:59:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qENiRLPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:59:24 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a85c98-2578-4ca7-915d-12e942820aea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 06:59:24 user nova-compute[74870]: No targets found.
Nov 28 06:59:24 user nova-compute[74870]: iSNS:
Nov 28 06:59:24 user nova-compute[74870]: No targets found.
Nov 28 06:59:24 user nova-compute[74870]: STATIC:
Nov 28 06:59:24 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 06:59:24 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:59:24 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:59:24 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8
Nov 28 06:59:24 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 06:59:24 user nova-compute[74870]:                 Iface Name: default
Nov 28 06:59:24 user nova-compute[74870]: FIRMWARE:
Nov 28 06:59:24 user nova-compute[74870]: No targets found.
Nov 28 06:59:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 06:59:24 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 06:59:24 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1799a-cd2f-4b5c-a251-cfbf274780f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b70a4-19df-4cd7-b41c-a51994138d34]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:24 user nova-compute[74870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)
Nov 28 06:59:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:24 user nova-compute[74870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 (non-flash)
Nov 28 06:59:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc2dba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8'): ({'sdd'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Removing single pathed devices sdd {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec80202-1e58-4582-b517-2ea2f5cd4112]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9338e990-b611-4587-8764-6871b120dd59]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flushing IO for device /dev/sdd {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23977d8-d0fc-4698-822a-f3862083afa5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15221659-9b22-4b74-b9a7-c07e6722eff9]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016780f-9bdc-42e8-abe2-69f1c1b7c50d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc2fd85-d91a-4833-b7a0-6e8fe3e7a6af]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260]
Nov 28 06:59:24 user nova-compute[74870]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8, portal: 172.16.0.220,3260] successful.
Nov 28 06:59:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5af4b7-5758-4a72-bf9f-738feb2c01c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf9e7a2-726d-41ae-87d8-7fb7bb887cae]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] <== disconnect_volume: return (292ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:59:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG nova.objects.instance [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'flavor' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.774s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:59:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=25.317626953125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:27 user nova-compute[74870]: INFO nova.compute.manager [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Terminating instance
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 304574e5-b806-44dc-9302-cdce2822898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-vif-unplugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] No waiting events found dispatching network-vif-unplugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-vif-unplugged-97da79b7-c41c-46da-8faa-03d072c630a6 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Instance destroyed successfully.
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'resources' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1534702303',display_name='tempest-AttachVolumeTestJSON-server-1534702303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1534702303',id=38,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeL1D4XRxzvT/Z60Ib+3FUK5/1PR8cLQz940qRyjWckwR3Q22IKZERaEWQ61+imcHTbDt7QT2R5/EA26wbBSfVguaOQgWpLV4txliTaqKMuQOQdMsadd/OnwheDO3H/5Q==',key_name='tempest-keypair-34936543',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:56:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a4f8529212249d68a54698cffcdc44b',ramdisk_id='',reservation_id='r-nvvaxff8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-25504685',owner_user_name='tempest-AttachVolumeTestJSON-25504685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63fdd08d34954e97ae65ec1ce1c3d0f6',uuid=92e60471-f6da-476c-b0de-c729eec1b2b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converting VIF {"id": "97da79b7-c41c-46da-8faa-03d072c630a6", "address": "fa:16:3e:27:6d:c1", "network": {"id": "4674e5d4-7ef8-4582-a62f-45a48e5164b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1456878342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a4f8529212249d68a54698cffcdc44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97da79b7-c4", "ovs_interfaceid": "97da79b7-c41c-46da-8faa-03d072c630a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG os_vif [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97da79b7-c4, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9621b144-38ea-456e-b10f-3296583d0643) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:28 user nova-compute[74870]: INFO os_vif [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:6d:c1,bridge_name='br-int',has_traffic_filtering=True,id=97da79b7-c41c-46da-8faa-03d072c630a6,network=Network(4674e5d4-7ef8-4582-a62f-45a48e5164b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97da79b7-c4')
Nov 28 06:59:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Deleting instance files /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4_del
Nov 28 06:59:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Deletion of /opt/stack/data/nova/instances/92e60471-f6da-476c-b0de-c729eec1b2b4_del complete
Nov 28 06:59:28 user nova-compute[74870]: INFO nova.compute.manager [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 06:59:28 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:59:28 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Took 0.83 seconds to deallocate network for instance.
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 06:59:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Creating image(s)
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Ensure instance console log exists: /opt/stack/data/nova/instances/304574e5-b806-44dc-9302-cdce2822898f/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Start _get_guest_xml network_info=[{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXOWGSxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '304574e5-b806-44dc-9302-cdce2822898f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed591127-ee7f-497d-9cfc-4cd2e691c235', 'serial': 'ed591127-ee7f-497d-9cfc-4cd2e691c235'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'dce78032-af26-4b78-a0ef-0a52c6d4c7b9', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 06:59:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:59:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 06:59:28 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXOWGSxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:59:29 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:59:29 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:59:29 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f0b31b-fd1a-4291-9424-3708c3eb2746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:59:29 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9de25-9424-47dd-a485-4cc260728c08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235] added
Nov 28 06:59:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68adb12-7742-40ce-a452-ffbc67ff7cae]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce832d53-c2d7-47db-a221-55c54420640f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXOWGSxJ {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXOWGSxJ" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[152dcbbe-d659-4529-94d3-8a3e9cea9ac1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXOWGSxJ'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d454177-b3a3-4c50-b644-0c656a65c740]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dd5c41-b53c-498b-9495-68717c0fc5f9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b46c777-703f-488f-8a06-6f54fa4378b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260]
Nov 28 06:59:29 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260] successful.
Nov 28 06:59:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[618dfece-e8bb-44e0-a9b0-cc30c84ec491]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbc16c8-7b07-4966-985a-e8d348bc8109]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:29 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 06:59:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:29 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 06:59:29 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e49b59-9e3a-438b-8fc4-d7ef84b0039d]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXOWGSxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:29 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Deleted allocations for instance 92e60471-f6da-476c-b0de-c729eec1b2b4
Nov 28 06:59:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Acquiring lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] No waiting events found dispatching network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:59:29 user nova-compute[74870]: WARNING nova.compute.manager [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received unexpected event network-vif-plugged-97da79b7-c41c-46da-8faa-03d072c630a6 for instance with vm_state deleted and task_state None.
Nov 28 06:59:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Received event network-vif-deleted-97da79b7-c41c-46da-8faa-03d072c630a6 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "92e60471-f6da-476c-b0de-c729eec1b2b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26361383239303461', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361383239303461', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1208701007',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1208701007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1208701007',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw/bgJM7S7KTViraEzpff75LdAz+7XKA3V0OajZokvNlT8+UF+rFN68SYhnsA4uQlPYo6UuoIvnVGIHXMcO6dX9mYxRXnFeRY818AlVAV+XmpPx5B1+yb6wwqL2D5PHwg==',key_name='tempest-keypair-6317093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-zj121k9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:59:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=304574e5-b806-44dc-9302-cdce2822898f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'pci_devices' on Instance uuid 304574e5-b806-44dc-9302-cdce2822898f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 06:59:30 user nova-compute[74870]:   <uuid>304574e5-b806-44dc-9302-cdce2822898f</uuid>
Nov 28 06:59:30 user nova-compute[74870]:   <name>instance-0000002b</name>
Nov 28 06:59:30 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 06:59:30 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 06:59:30 user nova-compute[74870]:   <metadata>
Nov 28 06:59:30 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 06:59:30 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 06:59:30 user nova-compute[74870]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1208701007</nova:name>
Nov 28 06:59:30 user nova-compute[74870]:       <nova:creationTime>2023-11-28 06:59:28</nova:creationTime>
Nov 28 06:59:30 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 06:59:30 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 06:59:30 user nova-compute[74870]:       </nova:flavor>
Nov 28 06:59:30 user nova-compute[74870]:       <nova:owner>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:user uuid="2139976b453e4bd2b8e83e551a0cc772">tempest-TestVolumeBootPattern-1541228194-project-member</nova:user>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:project uuid="cecfa8e54acf42a8affd8686f500d6c9">tempest-TestVolumeBootPattern-1541228194</nova:project>
Nov 28 06:59:30 user nova-compute[74870]:       </nova:owner>
Nov 28 06:59:30 user nova-compute[74870]:       <nova:ports>
Nov 28 06:59:30 user nova-compute[74870]:         <nova:port uuid="3eb0757a-68b5-4718-b270-812c217e9e86">
Nov 28 06:59:30 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 06:59:30 user nova-compute[74870]:         </nova:port>
Nov 28 06:59:30 user nova-compute[74870]:       </nova:ports>
Nov 28 06:59:30 user nova-compute[74870]:     </nova:instance>
Nov 28 06:59:30 user nova-compute[74870]:   </metadata>
Nov 28 06:59:30 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 06:59:30 user nova-compute[74870]:     <system>
Nov 28 06:59:30 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 06:59:30 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 06:59:30 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 06:59:30 user nova-compute[74870]:       <entry name="serial">304574e5-b806-44dc-9302-cdce2822898f</entry>
Nov 28 06:59:30 user nova-compute[74870]:       <entry name="uuid">304574e5-b806-44dc-9302-cdce2822898f</entry>
Nov 28 06:59:30 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 06:59:30 user nova-compute[74870]:     </system>
Nov 28 06:59:30 user nova-compute[74870]:   </sysinfo>
Nov 28 06:59:30 user nova-compute[74870]:   <os>
Nov 28 06:59:30 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 06:59:30 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 06:59:30 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 06:59:30 user nova-compute[74870]:   </os>
Nov 28 06:59:30 user nova-compute[74870]:   <features>
Nov 28 06:59:30 user nova-compute[74870]:     <acpi/>
Nov 28 06:59:30 user nova-compute[74870]:     <apic/>
Nov 28 06:59:30 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 06:59:30 user nova-compute[74870]:   </features>
Nov 28 06:59:30 user nova-compute[74870]:   <clock offset="utc">
Nov 28 06:59:30 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 06:59:30 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 06:59:30 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 06:59:30 user nova-compute[74870]:   </clock>
Nov 28 06:59:30 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 06:59:30 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 06:59:30 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 06:59:30 user nova-compute[74870]:   </cpu>
Nov 28 06:59:30 user nova-compute[74870]:   <devices>
Nov 28 06:59:30 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 06:59:30 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:59:30 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 06:59:30 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 06:59:30 user nova-compute[74870]:       <serial>ed591127-ee7f-497d-9cfc-4cd2e691c235</serial>
Nov 28 06:59:30 user nova-compute[74870]:     </disk>
Nov 28 06:59:30 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 06:59:30 user nova-compute[74870]:       <mac address="fa:16:3e:98:16:2a"/>
Nov 28 06:59:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:59:30 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 06:59:30 user nova-compute[74870]:       <target dev="tap3eb0757a-68"/>
Nov 28 06:59:30 user nova-compute[74870]:     </interface>
Nov 28 06:59:30 user nova-compute[74870]:     <serial type="pty">
Nov 28 06:59:30 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/304574e5-b806-44dc-9302-cdce2822898f/console.log" append="off"/>
Nov 28 06:59:30 user nova-compute[74870]:     </serial>
Nov 28 06:59:30 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 06:59:30 user nova-compute[74870]:     <video>
Nov 28 06:59:30 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 06:59:30 user nova-compute[74870]:     </video>
Nov 28 06:59:30 user nova-compute[74870]:     <rng model="virtio">
Nov 28 06:59:30 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 06:59:30 user nova-compute[74870]:     </rng>
Nov 28 06:59:30 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 06:59:30 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 06:59:30 user nova-compute[74870]:       <stats period="10"/>
Nov 28 06:59:30 user nova-compute[74870]:     </memballoon>
Nov 28 06:59:30 user nova-compute[74870]:   </devices>
Nov 28 06:59:30 user nova-compute[74870]: </domain>
Nov 28 06:59:30 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1208701007',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1208701007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1208701007',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw/bgJM7S7KTViraEzpff75LdAz+7XKA3V0OajZokvNlT8+UF+rFN68SYhnsA4uQlPYo6UuoIvnVGIHXMcO6dX9mYxRXnFeRY818AlVAV+XmpPx5B1+yb6wwqL2D5PHwg==',key_name='tempest-keypair-6317093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-zj121k9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T06:59:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=304574e5-b806-44dc-9302-cdce2822898f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG os_vif [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5ffd440-a7f5-54da-b026-681571cd8c92', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb0757a-68, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eb0757a-68, col_values=(('qos', UUID('71d9d562-7d56-4058-89c7-496de1a2bc03')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eb0757a-68, col_values=(('external_ids', {'iface-id': '3eb0757a-68b5-4718-b270-812c217e9e86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:16:2a', 'vm-uuid': '304574e5-b806-44dc-9302-cdce2822898f'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:30 user nova-compute[74870]: INFO os_vif [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68')
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:59:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No VIF found with MAC fa:16:3e:98:16:2a, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] No waiting events found dispatching network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:59:32 user nova-compute[74870]: WARNING nova.compute.manager [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received unexpected event network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 for instance with vm_state building and task_state spawning.
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'flavor' on Instance uuid 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:33 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Ignoring supplied device name: /dev/vdb
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:33 user nova-compute[74870]: INFO nova.compute.manager [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Attaching volume 90e15ebf-04e6-4180-84e5-32f2d8233f31 to /dev/vdb
Nov 28 06:59:33 user nova-compute[74870]: DEBUG os_brick.utils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a742ea6-eedd-46d9-9af4-cde9a477bd9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e254ed0-cd7e-4e04-9038-62c733e61188]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e5bdd-9bdf-4adb-8268-b19adfeced38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18acd2c1-cf71-4ac8-9480-bc47295156d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 06:59:33 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 06:59:33 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[094c9a04-da14-42f0-b810-5e972c49d710]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG os_brick.utils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:59:33 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updating existing volume attachment record: 8f1dfe77-a78e-49c3-9bd1-29f4f7858220 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 06:59:34 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Instance spawned successfully.
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 06:59:34 user nova-compute[74870]: INFO nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] No waiting events found dispatching network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 06:59:34 user nova-compute[74870]: WARNING nova.compute.manager [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received unexpected event network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 for instance with vm_state building and task_state spawning.
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-changed-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Refreshing instance network info cache due to event network-changed-e801ef0c-430d-49ef-8691-ef7c7678c8c5. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Acquiring lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Acquired lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.network.neutron [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Refreshing network info cache for port e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 06:59:34 user nova-compute[74870]: INFO nova.compute.manager [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Took 13.50 seconds to build instance.
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "304574e5-b806-44dc-9302-cdce2822898f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.612s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.network.neutron [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updated VIF entry in instance network info cache for port e801ef0c-430d-49ef-8691-ef7c7678c8c5. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG nova.network.neutron [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updating instance_info_cache with network_info: [{"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 06:59:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Releasing lock "refresh_cache-572ab6e9-7bbc-44ad-9e20-c53c17ed333f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 06:59:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 06:59:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 06:59:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZulvcqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 06:59:41 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:59:41 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 06:59:41 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a90016-eb12-4d34-b87f-5a07f0820af4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 06:59:41 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8191f63-9b75-4a8e-b411-33bd123388c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31] added
Nov 28 06:59:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3459c11-715b-4f68-b5a1-451841973e5f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d8fa27-5c10-4531-bd97-20ec3f351b28]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZulvcqi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZulvcqi" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14e5979-0645-4150-a2f5-9c39700e0674]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZulvcqi'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c16a56d-bbec-4e83-89fc-d7a117124db2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[970887bf-6aee-49c3-8f88-7966286721f2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:41 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 06:59:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:41 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 06:59:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:59:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c57f1-0244-424c-aa0d-5e517c75bb1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260]
Nov 28 06:59:42 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260] successful.
Nov 28 06:59:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97175f59-9561-4ca4-9c4e-6ee794e71416]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da9bc0-6755-4e97-9a99-799cc65f64f4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:42 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 06:59:42 user nova-compute[74870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 (non-flash)
Nov 28 06:59:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 06:59:42 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 06:59:42 user nova-compute[74870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 (non-flash)
Nov 28 06:59:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4999352-5c79-4848-a8cc-36a16084e022]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 06:59:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZulvcqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23065373862393465', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065373862393465', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG nova.objects.instance [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'flavor' on Instance uuid 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 06:59:43 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 06:59:43 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 06:59:43 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 06:59:43 user nova-compute[74870]:   <serial>90e15ebf-04e6-4180-84e5-32f2d8233f31</serial>
Nov 28 06:59:43 user nova-compute[74870]: </disk>
Nov 28 06:59:43 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No VIF found with MAC fa:16:3e:e5:65:38, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 06:59:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.879s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 06:59:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:47 user nova-compute[74870]: INFO nova.compute.manager [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Get console output
Nov 28 06:59:47 user nova-compute[74870]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 06:59:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 06:59:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:05 user nova-compute[74870]: INFO nova.compute.manager [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Detaching volume 90e15ebf-04e6-4180-84e5-32f2d8233f31
Nov 28 07:00:05 user nova-compute[74870]: INFO nova.virt.block_device [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Attempting to driver detach volume 90e15ebf-04e6-4180-84e5-32f2d8233f31 from mountpoint /dev/vdb
Nov 28 07:00:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Attempting to detach device vdb from instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:00:05 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:00:05 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 07:00:05 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:00:05 user nova-compute[74870]:   <serial>90e15ebf-04e6-4180-84e5-32f2d8233f31</serial>
Nov 28 07:00:05 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:00:05 user nova-compute[74870]: </disk>
Nov 28 07:00:05 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:00:05 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully detached device vdb from instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f from the persistent domain config.
Nov 28 07:00:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:00:05 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:00:05 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 07:00:05 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:00:05 user nova-compute[74870]:   <serial>90e15ebf-04e6-4180-84e5-32f2d8233f31</serial>
Nov 28 07:00:05 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:00:05 user nova-compute[74870]: </disk>
Nov 28 07:00:05 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:05 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:00:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:00:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:00:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:00:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f is timed out.
Nov 28 07:00:25 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully detached device vdb from instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f from the live domain config.
Nov 28 07:00:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZulvcqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:00:25 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe648056-1fd0-4640-81d4-73c47882df9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:00:25 user nova-compute[74870]: No targets found.
Nov 28 07:00:25 user nova-compute[74870]: iSNS:
Nov 28 07:00:25 user nova-compute[74870]: No targets found.
Nov 28 07:00:25 user nova-compute[74870]: STATIC:
Nov 28 07:00:25 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31
Nov 28 07:00:25 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:25 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:25 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 07:00:25 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:25 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:25 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:00:25 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:25 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:25 user nova-compute[74870]: FIRMWARE:
Nov 28 07:00:25 user nova-compute[74870]: No targets found.
Nov 28 07:00:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:00:25 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:00:25 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e950f058-2ef5-4339-88d1-7e995fa70993]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e505025-742b-4c1a-a53b-9307c8fe28fc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 07:00:25 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:00:25 user nova-compute[74870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 (non-flash)
Nov 28 07:00:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 07:00:25 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:00:25 user nova-compute[74870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 (non-flash)
Nov 28 07:00:25 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc59d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31'): ({'sdd'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Removing single pathed devices sdd {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d362ab5c-e1b2-467a-8ce5-719f3444db6f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[327354f9-92f8-470b-bde0-c5259c96224b]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flushing IO for device /dev/sdd {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[99547f90-45e8-4a35-a696-1f07aa7706bd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d19df57-1a12-4b4e-baac-e5ddc9f4e512]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d773025e-3b9e-4b22-8d64-527ba24b1f46]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed92fc4-e037-4388-b5bb-1d47d0f9fee4]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260]
Nov 28 07:00:26 user nova-compute[74870]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31, portal: 172.16.0.220,3260] successful.
Nov 28 07:00:26 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72447fc-77fa-4cad-81e5-ea2c04e29e79]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== disconnect_volume: return (362ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:00:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:00:26 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=25.332096099853516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance edb101d9-028e-4191-84a2-1169555a21ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 304574e5-b806-44dc-9302-cdce2822898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 07:00:26 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.objects.instance [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'flavor' on Instance uuid 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.881s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:27 user nova-compute[74870]: INFO nova.compute.manager [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Terminating instance
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-vif-unplugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] No waiting events found dispatching network-vif-unplugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:00:27 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-vif-unplugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Instance destroyed successfully.
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'resources' on Instance uuid 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1110125265',display_name='tempest-VolumesSnapshotTestJSON-instance-1110125265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1110125265',id=41,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTeezUJfCy/PdT+5o55bBNniwqT/C6qqK5jybin9WqPIXvk//VYsW599FvWs1SqmYte1wj8MgqbzNjVg0sbpCKLN+EFeGh1OIohCgRfN10CZaS+lJIKEf4/u7bdxWEOVA==',key_name='tempest-keypair-536756227',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82be9b17ed614b8aa2bb7172eedf516e',ramdisk_id='',reservation_id='r-g02qhrnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-719548845',owner_user_name='tempest-VolumesSnapshotTestJSON-719548845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eb76cab93f4dfd97bf85828d89df68',uuid=572ab6e9-7bbc-44ad-9e20-c53c17ed333f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converting VIF {"id": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "address": "fa:16:3e:e5:65:38", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801ef0c-43", "ovs_interfaceid": "e801ef0c-430d-49ef-8691-ef7c7678c8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_vif [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape801ef0c-43, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f4fce74-3e7e-45ea-8650-ff135deda6e3) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:28 user nova-compute[74870]: INFO os_vif [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:65:38,bridge_name='br-int',has_traffic_filtering=True,id=e801ef0c-430d-49ef-8691-ef7c7678c8c5,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801ef0c-43')
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZulvcqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:00:28 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[551c16c7-14ad-4c5e-97e1-2a3285ac3b3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:00:28 user nova-compute[74870]: No targets found.
Nov 28 07:00:28 user nova-compute[74870]: iSNS:
Nov 28 07:00:28 user nova-compute[74870]: No targets found.
Nov 28 07:00:28 user nova-compute[74870]: STATIC:
Nov 28 07:00:28 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 07:00:28 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:28 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:28 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:00:28 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:28 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:28 user nova-compute[74870]: FIRMWARE:
Nov 28 07:00:28 user nova-compute[74870]: No targets found.
Nov 28 07:00:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:00:28 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:00:28 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e15ebf-04e6-4180-84e5-32f2d8233f31', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90fb859-fe85-437a-b175-ca86c05f8cc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df3cc1d-3dbb-48d6-86cf-c0e50505daec]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 07:00:28 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:00:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 07:00:28 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:00:28 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc59cd30>, {}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Disconnecting from: [] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== disconnect_volume: return (100ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:00:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Deleting instance files /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f_del
Nov 28 07:00:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Deletion of /opt/stack/data/nova/instances/572ab6e9-7bbc-44ad-9e20-c53c17ed333f_del complete
Nov 28 07:00:28 user nova-compute[74870]: INFO nova.compute.manager [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 28 07:00:28 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:00:28 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Acquiring lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] No waiting events found dispatching network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:00:29 user nova-compute[74870]: WARNING nova.compute.manager [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received unexpected event network-vif-plugged-e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance with vm_state active and task_state deleting.
Nov 28 07:00:30 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:00:30 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Took 1.85 seconds to deallocate network for instance.
Nov 28 07:00:30 user nova-compute[74870]: WARNING nova.volume.cinder [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Attachment 8f1dfe77-a78e-49c3-9bd1-29f4f7858220 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8f1dfe77-a78e-49c3-9bd1-29f4f7858220. (HTTP 404) (Request-ID: req-c8917a76-de18-4cb6-9e31-d324651d4baf)
Nov 28 07:00:30 user nova-compute[74870]: INFO nova.compute.manager [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 07:00:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Received event network-vif-deleted-e801ef0c-430d-49ef-8691-ef7c7678c8c5 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:30 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:00:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:00:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:30 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Deleted allocations for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f
Nov 28 07:00:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "572ab6e9-7bbc-44ad-9e20-c53c17ed333f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.604s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 5e69254a-5914-4e90-ae6e-bdf28ac716e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [{"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-5e69254a-5914-4e90-ae6e-bdf28ac716e7" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:00:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:00:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing instance network info cache due to event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updated VIF entry in instance network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:00:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:00:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:46 user nova-compute[74870]: INFO nova.compute.manager [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Shelving
Nov 28 07:00:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-unplugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-unplugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:00:46 user nova-compute[74870]: WARNING nova.compute.manager [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-unplugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state active and task_state shelving.
Nov 28 07:00:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance destroyed successfully.
Nov 28 07:00:47 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Beginning cold snapshot process
Nov 28 07:00:47 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk /opt/stack/data/nova/instances/snapshots/tmps1z9woh3/94dcbee5fab04ebc997996b3f24db0f1 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:47 user nova-compute[74870]: INFO nova.compute.manager [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Terminating instance
Nov 28 07:00:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:00:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-unplugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-unplugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-unplugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Instance destroyed successfully.
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.objects.instance [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'resources' on Instance uuid edb101d9-028e-4191-84a2-1169555a21ad {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:54:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1276738302',display_name='tempest-ServerActionsTestOtherA-server-1276738302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1276738302',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:56:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-16mc3gdc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=edb101d9-028e-4191-84a2-1169555a21ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "address": "fa:16:3e:69:a9:51", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9931d17e-bd", "ovs_interfaceid": "9931d17e-bd7c-4a94-a98b-347ac890bcc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_vif [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9931d17e-bd, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5186f93f-c1ac-40fb-9b16-3c031236076a) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:48 user nova-compute[74870]: INFO os_vif [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=9931d17e-bd7c-4a94-a98b-347ac890bcc2,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9931d17e-bd')
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSgjXJpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:00:48 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e186a-b270-4dbf-8eaa-5bb177d978c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:00:48 user nova-compute[74870]: No targets found.
Nov 28 07:00:48 user nova-compute[74870]: iSNS:
Nov 28 07:00:48 user nova-compute[74870]: No targets found.
Nov 28 07:00:48 user nova-compute[74870]: STATIC:
Nov 28 07:00:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534
Nov 28 07:00:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:48 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:00:48 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:00:48 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:00:48 user nova-compute[74870]: FIRMWARE:
Nov 28 07:00:48 user nova-compute[74870]: No targets found.
Nov 28 07:00:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:00:48 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:00:48 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk /opt/stack/data/nova/instances/snapshots/tmps1z9woh3/94dcbee5fab04ebc997996b3f24db0f1" returned: 0 in 1.084s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Snapshot extracted, beginning image upload
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b193358-4048-4a05-b2d1-3c807cc9679b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72056725-077f-4f27-91f1-1a44d6d93b93]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 07:00:48 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:00:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 (non-flash)
Nov 28 07:00:48 user nova-compute[74870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:00:48 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc59edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b73185-8a58-4fc3-a6b6-697e4b2e64ba]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e74712a-5361-4e30-819e-49f3179fb081]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[031d5c79-0e6b-4b55-86c8-d5848b43d9a4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8788e75-f0c8-46fe-854a-6a859fddaa09]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5f9f4d-268b-40da-8767-17ebe7e5c3da]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:00:49 user nova-compute[74870]: WARNING nova.compute.manager [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[183a0794-33e7-4894-9276-c3446c874716]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260]
Nov 28 07:00:49 user nova-compute[74870]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534, portal: 172.16.0.220,3260] successful.
Nov 28 07:00:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9f5caf-7a60-4516-a4f2-a928bca26534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16a3283-3977-40e9-ad77-c1ac2b8145ef]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] <== disconnect_volume: return (345ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:00:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Deleting instance files /opt/stack/data/nova/instances/edb101d9-028e-4191-84a2-1169555a21ad_del
Nov 28 07:00:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Deletion of /opt/stack/data/nova/instances/edb101d9-028e-4191-84a2-1169555a21ad_del complete
Nov 28 07:00:49 user nova-compute[74870]: INFO nova.compute.manager [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 28 07:00:49 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:49 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:00:49 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Took 0.73 seconds to deallocate network for instance.
Nov 28 07:00:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Acquiring lock "edb101d9-028e-4191-84a2-1169555a21ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Lock "edb101d9-028e-4191-84a2-1169555a21ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] No waiting events found dispatching network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:00:50 user nova-compute[74870]: WARNING nova.compute.manager [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received unexpected event network-vif-plugged-9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance with vm_state active and task_state deleting.
Nov 28 07:00:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Received event network-vif-deleted-9931d17e-bd7c-4a94-a98b-347ac890bcc2 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:50 user nova-compute[74870]: INFO nova.compute.manager [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Took 0.94 seconds to detach 1 volumes for instance.
Nov 28 07:00:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Deleting volume: 4c9f5caf-7a60-4516-a4f2-a928bca26534 {{(pid=74870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 07:00:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:51 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:00:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:00:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:51 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Deleted allocations for instance edb101d9-028e-4191-84a2-1169555a21ad
Nov 28 07:00:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "edb101d9-028e-4191-84a2-1169555a21ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.443s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Snapshot image upload complete
Nov 28 07:00:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:00:51 user nova-compute[74870]: INFO nova.compute.manager [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Shelve offloading
Nov 28 07:00:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance destroyed successfully.
Nov 28 07:00:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:00:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:00:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:00:51 user nova-compute[74870]: DEBUG nova.network.neutron [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:00:52 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance destroyed successfully.
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'resources' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1985880305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1985880305',id=42,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPwnK6lmjMoJybvl5cVU2MnwVHXFMNeaO8Rsnt98BjuMQVUOleaBJRxeVYQX7a8iMW/3nZ6jmfwOilHW6nIAGbi0+22NgwmT8lUhLxagB/l+ms7V0NW840WRlnEpKPZA==',key_name='tempest-keypair-1691834733',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-0tb0vdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member',shelved_at='2023-11-28T07:00:51.788082',shelved_host='user',shelved_image_id='0a89e715-c43d-4e25-9001-c82267f00e43'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=57d4327e-1732-4e71-be0d-05ae08e312b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG os_vif [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8282f0c-78, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing instance network info cache due to event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG nova.network.neutron [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47959a36-cda7-43bd-87e1-27581ec72255) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:00:52 user nova-compute[74870]: INFO os_vif [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78')
Nov 28 07:00:52 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Deleting instance files /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5_del
Nov 28 07:00:52 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Deletion of /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5_del complete
Nov 28 07:00:53 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Deleted allocations for instance 57d4327e-1732-4e71-be0d-05ae08e312b5
Nov 28 07:00:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'numa_topology' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG nova.objects.base [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<57d4327e-1732-4e71-be0d-05ae08e312b5> lazy-loaded attributes: resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG nova.network.neutron [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updated VIF entry in instance network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG nova.network.neutron [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb8282f0c-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.788s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:00:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:00:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:00:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:01:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:01:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:01:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-changed-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Refreshing instance network info cache due to event network-changed-3eb0757a-68b5-4718-b270-812c217e9e86. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:01:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Acquiring lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:01:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Acquired lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:01:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Refreshing network info cache for port 3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:01:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG nova.network.neutron [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updated VIF entry in instance network info cache for port 3eb0757a-68b5-4718-b270-812c217e9e86. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG nova.network.neutron [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating instance_info_cache with network_info: [{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Releasing lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:01:13 user nova-compute[74870]: INFO nova.compute.claims [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Claim successful on node user
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:01:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.policy [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:01:13 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Creating image(s)
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "/opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "/opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "/opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:13 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.213s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk 1073741824" returned: 0 in 0.064s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Successfully created port: 6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Cannot resize image /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Ensure instance console log exists: /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Successfully updated port: 6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquired lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-changed-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Refreshing instance network info cache due to event network-changed-6e515013-115b-4ad7-9ffb-f4aebd5cca06. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Acquiring lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:01:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updating instance_info_cache with network_info: [{"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Releasing lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Instance network_info: |[{"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Acquired lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Refreshing network info cache for port 6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Start _get_guest_xml network_info=[{"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:01:15 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:01:15 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-187360494',display_name='tempest-VolumesSnapshotTestJSON-instance-187360494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-187360494',id=44,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILnZ2bSYD7C7qQpY3V/IJDltBTIc6Dlzb+LlSUgAknlnhIs7hnELxdz9TrmSJPvyqkS7nZGtlgdt6xLyjIWPLsz31+3N20PY9yNf3/tdKzT6WIf/5v0Co0KV5lMCJu2/A==',key_name='tempest-keypair-74843823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82be9b17ed614b8aa2bb7172eedf516e',ramdisk_id='',reservation_id='r-hsa9c8ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-719548845',owner_user_name='tempest-VolumesSnapshotTestJSON-719548845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eb76cab93f4dfd97bf85828d89df68',uuid=f69564a5-bf33-41a2-bc28-9bf7950be296,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converting VIF {"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'pci_devices' on Instance uuid f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:01:15 user nova-compute[74870]:   <uuid>f69564a5-bf33-41a2-bc28-9bf7950be296</uuid>
Nov 28 07:01:15 user nova-compute[74870]:   <name>instance-0000002c</name>
Nov 28 07:01:15 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:01:15 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:01:15 user nova-compute[74870]:   <metadata>
Nov 28 07:01:15 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:01:15 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:01:15 user nova-compute[74870]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-187360494</nova:name>
Nov 28 07:01:15 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:01:15</nova:creationTime>
Nov 28 07:01:15 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:01:15 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:01:15 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:01:15 user nova-compute[74870]:       <nova:owner>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:user uuid="37eb76cab93f4dfd97bf85828d89df68">tempest-VolumesSnapshotTestJSON-719548845-project-member</nova:user>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:project uuid="82be9b17ed614b8aa2bb7172eedf516e">tempest-VolumesSnapshotTestJSON-719548845</nova:project>
Nov 28 07:01:15 user nova-compute[74870]:       </nova:owner>
Nov 28 07:01:15 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 07:01:15 user nova-compute[74870]:       <nova:ports>
Nov 28 07:01:15 user nova-compute[74870]:         <nova:port uuid="6e515013-115b-4ad7-9ffb-f4aebd5cca06">
Nov 28 07:01:15 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 07:01:15 user nova-compute[74870]:         </nova:port>
Nov 28 07:01:15 user nova-compute[74870]:       </nova:ports>
Nov 28 07:01:15 user nova-compute[74870]:     </nova:instance>
Nov 28 07:01:15 user nova-compute[74870]:   </metadata>
Nov 28 07:01:15 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:01:15 user nova-compute[74870]:     <system>
Nov 28 07:01:15 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:01:15 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:01:15 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:01:15 user nova-compute[74870]:       <entry name="serial">f69564a5-bf33-41a2-bc28-9bf7950be296</entry>
Nov 28 07:01:15 user nova-compute[74870]:       <entry name="uuid">f69564a5-bf33-41a2-bc28-9bf7950be296</entry>
Nov 28 07:01:15 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:01:15 user nova-compute[74870]:     </system>
Nov 28 07:01:15 user nova-compute[74870]:   </sysinfo>
Nov 28 07:01:15 user nova-compute[74870]:   <os>
Nov 28 07:01:15 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:01:15 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:01:15 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:01:15 user nova-compute[74870]:   </os>
Nov 28 07:01:15 user nova-compute[74870]:   <features>
Nov 28 07:01:15 user nova-compute[74870]:     <acpi/>
Nov 28 07:01:15 user nova-compute[74870]:     <apic/>
Nov 28 07:01:15 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:01:15 user nova-compute[74870]:   </features>
Nov 28 07:01:15 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:01:15 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:01:15 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:01:15 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:01:15 user nova-compute[74870]:   </clock>
Nov 28 07:01:15 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:01:15 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:01:15 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:01:15 user nova-compute[74870]:   </cpu>
Nov 28 07:01:15 user nova-compute[74870]:   <devices>
Nov 28 07:01:15 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:01:15 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:01:15 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk"/>
Nov 28 07:01:15 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:01:15 user nova-compute[74870]:     </disk>
Nov 28 07:01:15 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:01:15 user nova-compute[74870]:       <mac address="fa:16:3e:ce:f2:3c"/>
Nov 28 07:01:15 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:01:15 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:01:15 user nova-compute[74870]:       <target dev="tap6e515013-11"/>
Nov 28 07:01:15 user nova-compute[74870]:     </interface>
Nov 28 07:01:15 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:01:15 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/console.log" append="off"/>
Nov 28 07:01:15 user nova-compute[74870]:     </serial>
Nov 28 07:01:15 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:01:15 user nova-compute[74870]:     <video>
Nov 28 07:01:15 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:01:15 user nova-compute[74870]:     </video>
Nov 28 07:01:15 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:01:15 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:01:15 user nova-compute[74870]:     </rng>
Nov 28 07:01:15 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:01:15 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:01:15 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:01:15 user nova-compute[74870]:     </memballoon>
Nov 28 07:01:15 user nova-compute[74870]:   </devices>
Nov 28 07:01:15 user nova-compute[74870]: </domain>
Nov 28 07:01:15 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-187360494',display_name='tempest-VolumesSnapshotTestJSON-instance-187360494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-187360494',id=44,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILnZ2bSYD7C7qQpY3V/IJDltBTIc6Dlzb+LlSUgAknlnhIs7hnELxdz9TrmSJPvyqkS7nZGtlgdt6xLyjIWPLsz31+3N20PY9yNf3/tdKzT6WIf/5v0Co0KV5lMCJu2/A==',key_name='tempest-keypair-74843823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82be9b17ed614b8aa2bb7172eedf516e',ramdisk_id='',reservation_id='r-hsa9c8ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-719548845',owner_user_name='tempest-VolumesSnapshotTestJSON-719548845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eb76cab93f4dfd97bf85828d89df68',uuid=f69564a5-bf33-41a2-bc28-9bf7950be296,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converting VIF {"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG os_vif [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '625220dd-fb02-5990-80f0-d153a45a3ce7', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e515013-11, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e515013-11, col_values=(('qos', UUID('66e9d059-e2a1-46a3-9838-9a60833e7d2f')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e515013-11, col_values=(('external_ids', {'iface-id': '6e515013-115b-4ad7-9ffb-f4aebd5cca06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f2:3c', 'vm-uuid': 'f69564a5-bf33-41a2-bc28-9bf7950be296'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:15 user nova-compute[74870]: INFO os_vif [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11')
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No VIF found with MAC fa:16:3e:ce:f2:3c, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updated VIF entry in instance network info cache for port 6e515013-115b-4ad7-9ffb-f4aebd5cca06. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updating instance_info_cache with network_info: [{"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Releasing lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] No waiting events found dispatching network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:01:16 user nova-compute[74870]: WARNING nova.compute.manager [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received unexpected event network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance with vm_state building and task_state spawning.
Nov 28 07:01:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:01:18 user nova-compute[74870]: INFO nova.compute.claims [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Claim successful on node user
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:01:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Instance spawned successfully.
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] No waiting events found dispatching network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:01:18 user nova-compute[74870]: WARNING nova.compute.manager [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received unexpected event network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance with vm_state building and task_state spawning.
Nov 28 07:01:19 user nova-compute[74870]: INFO nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 28 07:01:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:01:19 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:01:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:01:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:01:19 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:01:19 user nova-compute[74870]: INFO nova.virt.block_device [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Booting with volume snapshot 34565803-1982-4f51-b00f-e0784ea16e65 at /dev/vda
Nov 28 07:01:19 user nova-compute[74870]: INFO nova.compute.manager [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Took 6.12 seconds to build instance.
Nov 28 07:01:19 user nova-compute[74870]: DEBUG nova.policy [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:01:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.222s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:19 user nova-compute[74870]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Successfully created port: 039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Successfully updated port: 039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquired lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-changed-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Refreshing instance network info cache due to event network-changed-039674ae-aa8d-4194-a82a-0522d98a3e94. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Acquiring lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updating instance_info_cache with network_info: [{"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Releasing lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Instance network_info: |[{"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Acquired lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:01:20 user nova-compute[74870]: DEBUG nova.network.neutron [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Refreshing network info cache for port 039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:01:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updated VIF entry in instance network info cache for port 039674ae-aa8d-4194-a82a-0522d98a3e94. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:01:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updating instance_info_cache with network_info: [{"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Releasing lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG os_brick.utils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb6e33-6ce4-4a58-bea1-c07a33292d66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cc4e0c-61a3-4157-85e8-4d0aa7da0838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52141bfe-9fc4-4905-b586-533c0ef9978a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da8fd5e-a898-47d9-8b34-51113d0bdfc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:01:25 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:01:25 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bd9edb-13d1-4b7b-9bef-acab180e3429]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG os_brick.utils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updating existing volume attachment record: 1e32f55f-fbd4-4313-9459-69ebc53da751 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:01:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:01:28 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=25.33334732055664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 304574e5-b806-44dc-9302-cdce2822898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f69564a5-bf33-41a2-bc28-9bf7950be296 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:01:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:01:32 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Creating image(s)
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Ensure instance console log exists: /opt/stack/data/nova/instances/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Start _get_guest_xml network_info=[{"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T07:01:13Z,direct_url=<?>,disk_format='qcow2',id=9b35b5bc-a710-492d-93aa-ae06b4ac29b6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-883024175',owner='cecfa8e54acf42a8affd8686f500d6c9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T07:01:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuCoEDpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdf76225-a484-4ebf-b8df-50697f8b387b', 'serial': 'cdf76225-a484-4ebf-b8df-50697f8b387b'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '1e32f55f-fbd4-4313-9459-69ebc53da751', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:01:32 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:01:32 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T07:01:13Z,direct_url=<?>,disk_format='qcow2',id=9b35b5bc-a710-492d-93aa-ae06b4ac29b6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-883024175',owner='cecfa8e54acf42a8affd8686f500d6c9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T07:01:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuCoEDpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:01:32 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:01:32 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:01:32 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceafad52-af54-4a87-a348-2e1744a62555]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:01:32 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd41e66-e25e-47d0-b4c7-9db1d8add8ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b] added
Nov 28 07:01:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896aece-47c2-4eb1-8fa2-676a58490964]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f95a862-92b7-47ea-a2db-8686b2019f9a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuCoEDpF {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuCoEDpF" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc1ebf-d503-4a20-8c22-78c743059b5c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuCoEDpF'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea9bbb4-6c98-4401-bdfc-36c26708e904]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e5c672-4630-46a3-98de-60962f040cc4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:01:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:01:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b156c489-65db-440b-9298-13c81bd2abcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260]
Nov 28 07:01:32 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260] successful.
Nov 28 07:01:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e966eb-eb1b-46a2-b870-7c6a22892696]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28010d59-36ee-4f6a-8b4e-73c788c74103]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:01:32 user nova-compute[74870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b (non-flash)
Nov 28 07:01:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:01:32 user nova-compute[74870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b (non-flash)
Nov 28 07:01:32 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.042s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[655dd533-1f45-40b5-9f63-59866d7ce68f]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:01:32 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating instance_info_cache with network_info: [{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuCoEDpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23637383863333061', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383863333061', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-985455269',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-985455269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-985455269',id=45,image_ref='9b35b5bc-a710-492d-93aa-ae06b4ac29b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3yEiDYiUs/P5zKldbzJkovtF3EfJjvSuKt4/cua9dAZ7JiOcjNDIYOsr3PpzJvb5uB9NS9ux76qjy+rXD0s67lGDl07aeLGETyT5WUfbmW7fYH0T2knTlco6MKFAF0OA==',key_name='tempest-keypair-966967716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-wx78t1om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1541228194',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:01:33 user nova-compute[74870]:   <uuid>62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a</uuid>
Nov 28 07:01:33 user nova-compute[74870]:   <name>instance-0000002d</name>
Nov 28 07:01:33 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:01:33 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:01:33 user nova-compute[74870]:   <metadata>
Nov 28 07:01:33 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:01:33 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:01:33 user nova-compute[74870]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-985455269</nova:name>
Nov 28 07:01:33 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:01:32</nova:creationTime>
Nov 28 07:01:33 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:01:33 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:01:33 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:01:33 user nova-compute[74870]:       <nova:owner>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:user uuid="2139976b453e4bd2b8e83e551a0cc772">tempest-TestVolumeBootPattern-1541228194-project-member</nova:user>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:project uuid="cecfa8e54acf42a8affd8686f500d6c9">tempest-TestVolumeBootPattern-1541228194</nova:project>
Nov 28 07:01:33 user nova-compute[74870]:       </nova:owner>
Nov 28 07:01:33 user nova-compute[74870]:       <nova:root type="image" uuid="9b35b5bc-a710-492d-93aa-ae06b4ac29b6"/>
Nov 28 07:01:33 user nova-compute[74870]:       <nova:ports>
Nov 28 07:01:33 user nova-compute[74870]:         <nova:port uuid="039674ae-aa8d-4194-a82a-0522d98a3e94">
Nov 28 07:01:33 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 07:01:33 user nova-compute[74870]:         </nova:port>
Nov 28 07:01:33 user nova-compute[74870]:       </nova:ports>
Nov 28 07:01:33 user nova-compute[74870]:     </nova:instance>
Nov 28 07:01:33 user nova-compute[74870]:   </metadata>
Nov 28 07:01:33 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:01:33 user nova-compute[74870]:     <system>
Nov 28 07:01:33 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:01:33 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:01:33 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:01:33 user nova-compute[74870]:       <entry name="serial">62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a</entry>
Nov 28 07:01:33 user nova-compute[74870]:       <entry name="uuid">62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a</entry>
Nov 28 07:01:33 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:01:33 user nova-compute[74870]:     </system>
Nov 28 07:01:33 user nova-compute[74870]:   </sysinfo>
Nov 28 07:01:33 user nova-compute[74870]:   <os>
Nov 28 07:01:33 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:01:33 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:01:33 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:01:33 user nova-compute[74870]:   </os>
Nov 28 07:01:33 user nova-compute[74870]:   <features>
Nov 28 07:01:33 user nova-compute[74870]:     <acpi/>
Nov 28 07:01:33 user nova-compute[74870]:     <apic/>
Nov 28 07:01:33 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:01:33 user nova-compute[74870]:   </features>
Nov 28 07:01:33 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:01:33 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:01:33 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:01:33 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:01:33 user nova-compute[74870]:   </clock>
Nov 28 07:01:33 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:01:33 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:01:33 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:01:33 user nova-compute[74870]:   </cpu>
Nov 28 07:01:33 user nova-compute[74870]:   <devices>
Nov 28 07:01:33 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:01:33 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:01:33 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 07:01:33 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:01:33 user nova-compute[74870]:       <serial>cdf76225-a484-4ebf-b8df-50697f8b387b</serial>
Nov 28 07:01:33 user nova-compute[74870]:     </disk>
Nov 28 07:01:33 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:01:33 user nova-compute[74870]:       <mac address="fa:16:3e:0a:14:9a"/>
Nov 28 07:01:33 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:01:33 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:01:33 user nova-compute[74870]:       <target dev="tap039674ae-aa"/>
Nov 28 07:01:33 user nova-compute[74870]:     </interface>
Nov 28 07:01:33 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:01:33 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a/console.log" append="off"/>
Nov 28 07:01:33 user nova-compute[74870]:     </serial>
Nov 28 07:01:33 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:01:33 user nova-compute[74870]:     <video>
Nov 28 07:01:33 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:01:33 user nova-compute[74870]:     </video>
Nov 28 07:01:33 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:01:33 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:01:33 user nova-compute[74870]:     </rng>
Nov 28 07:01:33 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:01:33 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:01:33 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:01:33 user nova-compute[74870]:     </memballoon>
Nov 28 07:01:33 user nova-compute[74870]:   </devices>
Nov 28 07:01:33 user nova-compute[74870]: </domain>
Nov 28 07:01:33 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-985455269',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-985455269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-985455269',id=45,image_ref='9b35b5bc-a710-492d-93aa-ae06b4ac29b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3yEiDYiUs/P5zKldbzJkovtF3EfJjvSuKt4/cua9dAZ7JiOcjNDIYOsr3PpzJvb5uB9NS9ux76qjy+rXD0s67lGDl07aeLGETyT5WUfbmW7fYH0T2knTlco6MKFAF0OA==',key_name='tempest-keypair-966967716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-wx78t1om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1541228194',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG os_vif [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8a52afc-014b-5a53-9edf-613dfd57e71a', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap039674ae-aa, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap039674ae-aa, col_values=(('qos', UUID('7654f548-147c-45e1-a2dd-bd38da2df141')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap039674ae-aa, col_values=(('external_ids', {'iface-id': '039674ae-aa8d-4194-a82a-0522d98a3e94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:14:9a', 'vm-uuid': '62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:33 user nova-compute[74870]: INFO os_vif [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa')
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:01:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No VIF found with MAC fa:16:3e:0a:14:9a, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:01:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:35 user nova-compute[74870]: DEBUG nova.compute.manager [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] No waiting events found dispatching network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:01:35 user nova-compute[74870]: WARNING nova.compute.manager [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received unexpected event network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 for instance with vm_state building and task_state spawning.
Nov 28 07:01:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:01:37 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Instance spawned successfully.
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] No waiting events found dispatching network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:01:37 user nova-compute[74870]: WARNING nova.compute.manager [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received unexpected event network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 for instance with vm_state building and task_state spawning.
Nov 28 07:01:37 user nova-compute[74870]: INFO nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 28 07:01:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:01:37 user nova-compute[74870]: INFO nova.compute.manager [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Took 18.73 seconds to build instance.
Nov 28 07:01:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.829s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:01:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:42 user nova-compute[74870]: INFO nova.compute.manager [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Terminating instance
Nov 28 07:01:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-vif-unplugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] No waiting events found dispatching network-vif-unplugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-vif-unplugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:01:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Instance destroyed successfully.
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.objects.instance [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'resources' on Instance uuid 5e69254a-5914-4e90-ae6e-bdf28ac716e7 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1525899682',display_name='tempest-ServerActionsTestOtherA-server-1525899682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1525899682',id=18,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA==',key_name='tempest-keypair-695255668',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf9caaf7cab4c0eb3343ea2c2501481',ramdisk_id='',reservation_id='r-5wbgup3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1541374155',owner_user_name='tempest-ServerActionsTestOtherA-1541374155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b9a26798e14399ac1a70568432485e',uuid=5e69254a-5914-4e90-ae6e-bdf28ac716e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converting VIF {"id": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "address": "fa:16:3e:79:b3:8b", "network": {"id": "7ded7b1e-cfba-4af0-9866-0a4d18198920", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1871231598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf9caaf7cab4c0eb3343ea2c2501481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bc4fb8-44", "ovs_interfaceid": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG os_vif [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29bc4fb8-44, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ef7a136-91e4-4dcf-93dc-2cde446fb8af) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:43 user nova-compute[74870]: INFO os_vif [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:b3:8b,bridge_name='br-int',has_traffic_filtering=True,id=29bc4fb8-446c-405d-a18f-e0bf5bc21fc9,network=Network(7ded7b1e-cfba-4af0-9866-0a4d18198920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bc4fb8-44')
Nov 28 07:01:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Deleting instance files /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7_del
Nov 28 07:01:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Deletion of /opt/stack/data/nova/instances/5e69254a-5914-4e90-ae6e-bdf28ac716e7_del complete
Nov 28 07:01:43 user nova-compute[74870]: INFO nova.compute.manager [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 07:01:43 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:01:43 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:01:44 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:01:44 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Took 0.47 seconds to deallocate network for instance.
Nov 28 07:01:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:44 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:01:44 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:01:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:44 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Deleted allocations for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7
Nov 28 07:01:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.865s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Acquiring lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:01:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:01:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Lock "5e69254a-5914-4e90-ae6e-bdf28ac716e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:01:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] No waiting events found dispatching network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:01:45 user nova-compute[74870]: WARNING nova.compute.manager [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received unexpected event network-vif-plugged-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance with vm_state deleted and task_state None.
Nov 28 07:01:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Received event network-vif-deleted-29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:01:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:01:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:25 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:26 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:02:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:02:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:02:27 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.315261840820312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 304574e5-b806-44dc-9302-cdce2822898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f69564a5-bf33-41a2-bc28-9bf7950be296 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:02:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 304574e5-b806-44dc-9302-cdce2822898f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating instance_info_cache with network_info: [{"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-304574e5-b806-44dc-9302-cdce2822898f" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:02:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:39 user nova-compute[74870]: INFO nova.compute.manager [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Unshelving
Nov 28 07:02:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'pci_requests' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'numa_topology' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:02:39 user nova-compute[74870]: INFO nova.compute.claims [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Claim successful on node user
Nov 28 07:02:39 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:02:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:39 user nova-compute[74870]: INFO nova.network.neutron [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating port b8282f0c-783f-4279-b530-d188e9b43e49 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing instance network info cache due to event network-changed-b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:02:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Acquiring lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:02:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Creating image(s)
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Acquired lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Refreshing network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG nova.objects.base [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<57d4327e-1732-4e71-be0d-05ae08e312b5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG nova.virt.images [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 0a89e715-c43d-4e25-9001-c82267f00e43 was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.part /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updated VIF entry in instance network info cache for port b8282f0c-783f-4279-b530-d188e9b43e49. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG nova.network.neutron [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:02:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Releasing lock "refresh_cache-57d4327e-1732-4e71-be0d-05ae08e312b5" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.part /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.converted" returned: 0 in 0.529s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.959s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc,backing_fmt=raw /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc,backing_fmt=raw /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk 1073741824" returned: 0 in 0.050s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'migration_context' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:43 user nova-compute[74870]: DEBUG nova.objects.base [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<57d4327e-1732-4e71-be0d-05ae08e312b5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:02:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Rebasing disk image.
Nov 28 07:02:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:44 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c -F raw /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c -F raw /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk" returned: 0 in 2.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Ensure instance console log exists: /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Start _get_guest_xml network_info=[{"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0510ba701ea1e9c0b0498339fee20779',container_format='bare',created_at=2023-11-28T07:00:46Z,direct_url=<?>,disk_format='qcow2',id=0a89e715-c43d-4e25-9001-c82267f00e43,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1985880305-shelved',owner='9d769a1c976c468f804770d89c92ae94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T07:00:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:02:46 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:02:46 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0510ba701ea1e9c0b0498339fee20779',container_format='bare',created_at=2023-11-28T07:00:46Z,direct_url=<?>,disk_format='qcow2',id=0a89e715-c43d-4e25-9001-c82267f00e43,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1985880305-shelved',owner='9d769a1c976c468f804770d89c92ae94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T07:00:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.objects.base [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<57d4327e-1732-4e71-be0d-05ae08e312b5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1985880305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1985880305',id=42,image_ref='0a89e715-c43d-4e25-9001-c82267f00e43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1691834733',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-0tb0vdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member',shelved_at='2023-11-28T07:00:51.788082',shelved_host='user',shelved_image_id='0a89e715-c43d-4e25-9001-c82267f00e43'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=57d4327e-1732-4e71-be0d-05ae08e312b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'pci_devices' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.objects.base [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Object Instance<57d4327e-1732-4e71-be0d-05ae08e312b5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:02:46 user nova-compute[74870]:   <uuid>57d4327e-1732-4e71-be0d-05ae08e312b5</uuid>
Nov 28 07:02:46 user nova-compute[74870]:   <name>instance-0000002a</name>
Nov 28 07:02:46 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:02:46 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:02:46 user nova-compute[74870]:   <metadata>
Nov 28 07:02:46 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:02:46 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:02:46 user nova-compute[74870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1985880305</nova:name>
Nov 28 07:02:46 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:02:46</nova:creationTime>
Nov 28 07:02:46 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:02:46 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:02:46 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:02:46 user nova-compute[74870]:       <nova:owner>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:user uuid="dbf659ad4b8f43a2bc497d01be58d846">tempest-AttachVolumeShelveTestJSON-92318211-project-member</nova:user>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:project uuid="9d769a1c976c468f804770d89c92ae94">tempest-AttachVolumeShelveTestJSON-92318211</nova:project>
Nov 28 07:02:46 user nova-compute[74870]:       </nova:owner>
Nov 28 07:02:46 user nova-compute[74870]:       <nova:root type="image" uuid="0a89e715-c43d-4e25-9001-c82267f00e43"/>
Nov 28 07:02:46 user nova-compute[74870]:       <nova:ports>
Nov 28 07:02:46 user nova-compute[74870]:         <nova:port uuid="b8282f0c-783f-4279-b530-d188e9b43e49">
Nov 28 07:02:46 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 07:02:46 user nova-compute[74870]:         </nova:port>
Nov 28 07:02:46 user nova-compute[74870]:       </nova:ports>
Nov 28 07:02:46 user nova-compute[74870]:     </nova:instance>
Nov 28 07:02:46 user nova-compute[74870]:   </metadata>
Nov 28 07:02:46 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:02:46 user nova-compute[74870]:     <system>
Nov 28 07:02:46 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:02:46 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:02:46 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:02:46 user nova-compute[74870]:       <entry name="serial">57d4327e-1732-4e71-be0d-05ae08e312b5</entry>
Nov 28 07:02:46 user nova-compute[74870]:       <entry name="uuid">57d4327e-1732-4e71-be0d-05ae08e312b5</entry>
Nov 28 07:02:46 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:02:46 user nova-compute[74870]:     </system>
Nov 28 07:02:46 user nova-compute[74870]:   </sysinfo>
Nov 28 07:02:46 user nova-compute[74870]:   <os>
Nov 28 07:02:46 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:02:46 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:02:46 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:02:46 user nova-compute[74870]:   </os>
Nov 28 07:02:46 user nova-compute[74870]:   <features>
Nov 28 07:02:46 user nova-compute[74870]:     <acpi/>
Nov 28 07:02:46 user nova-compute[74870]:     <apic/>
Nov 28 07:02:46 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:02:46 user nova-compute[74870]:   </features>
Nov 28 07:02:46 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:02:46 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:02:46 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:02:46 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:02:46 user nova-compute[74870]:   </clock>
Nov 28 07:02:46 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:02:46 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:02:46 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:02:46 user nova-compute[74870]:   </cpu>
Nov 28 07:02:46 user nova-compute[74870]:   <devices>
Nov 28 07:02:46 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:02:46 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:02:46 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk"/>
Nov 28 07:02:46 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:02:46 user nova-compute[74870]:     </disk>
Nov 28 07:02:46 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:02:46 user nova-compute[74870]:       <mac address="fa:16:3e:b6:2b:ed"/>
Nov 28 07:02:46 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:02:46 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:02:46 user nova-compute[74870]:       <target dev="tapb8282f0c-78"/>
Nov 28 07:02:46 user nova-compute[74870]:     </interface>
Nov 28 07:02:46 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:02:46 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/console.log" append="off"/>
Nov 28 07:02:46 user nova-compute[74870]:     </serial>
Nov 28 07:02:46 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:02:46 user nova-compute[74870]:     <video>
Nov 28 07:02:46 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:02:46 user nova-compute[74870]:     </video>
Nov 28 07:02:46 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:02:46 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:02:46 user nova-compute[74870]:     </rng>
Nov 28 07:02:46 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:02:46 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:02:46 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:02:46 user nova-compute[74870]:     </memballoon>
Nov 28 07:02:46 user nova-compute[74870]:   </devices>
Nov 28 07:02:46 user nova-compute[74870]: </domain>
Nov 28 07:02:46 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1985880305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1985880305',id=42,image_ref='0a89e715-c43d-4e25-9001-c82267f00e43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1691834733',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-0tb0vdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member',shelved_at='2023-11-28T07:00:51.788082',shelved_host='user',shelved_image_id='0a89e715-c43d-4e25-9001-c82267f00e43'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=57d4327e-1732-4e71-be0d-05ae08e312b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG os_vif [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf86bdf1-5ea3-5a89-a324-6ad6f95c0118', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8282f0c-78, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8282f0c-78, col_values=(('qos', UUID('810112a1-648c-455b-bd3a-5b0c05e21a70')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8282f0c-78, col_values=(('external_ids', {'iface-id': 'b8282f0c-783f-4279-b530-d188e9b43e49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:2b:ed', 'vm-uuid': '57d4327e-1732-4e71-be0d-05ae08e312b5'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:46 user nova-compute[74870]: INFO os_vif [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78')
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:02:46 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] No VIF found with MAC fa:16:3e:b6:2b:ed, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:02:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:02:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:48 user nova-compute[74870]: DEBUG nova.compute.manager [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:02:48 user nova-compute[74870]: WARNING nova.compute.manager [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 07:02:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:02:50 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance spawned successfully.
Nov 28 07:02:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:02:50 user nova-compute[74870]: WARNING nova.compute.manager [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 07:02:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:02:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.016s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:02:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:02:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:03:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:03:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:03:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-changed-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Refreshing instance network info cache due to event network-changed-6e515013-115b-4ad7-9ffb-f4aebd5cca06. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Acquiring lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Acquired lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Refreshing network info cache for port 6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.objects.instance [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'flavor' on Instance uuid f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:03:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Ignoring supplied device name: /dev/vdb
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:04 user nova-compute[74870]: INFO nova.compute.manager [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Attaching volume a17dc5fd-07dd-4698-b421-981621d23318 to /dev/vdb
Nov 28 07:03:04 user nova-compute[74870]: DEBUG os_brick.utils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745256d-e9d4-49ff-9c49-7d20c6c5f69d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28263177-f82d-49c4-9b01-6a7411c59817]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667f0f7-aa4c-4ea2-8ab5-45123a7359f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[380edaae-0ce5-407f-88d7-9edcbeea0845]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updated VIF entry in instance network info cache for port 6e515013-115b-4ad7-9ffb-f4aebd5cca06. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.network.neutron [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updating instance_info_cache with network_info: [{"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Releasing lock "refresh_cache-f69564a5-bf33-41a2-bc28-9bf7950be296" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:03:04 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:03:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fc19f-7fe0-44ce-9502-ca5e57729b11]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG os_brick.utils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:04 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updating existing volume attachment record: 7a57a85b-b210-4981-855f-171560f77c41 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:03:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-changed-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Refreshing instance network info cache due to event network-changed-039674ae-aa8d-4194-a82a-0522d98a3e94. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Acquiring lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Acquired lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG nova.network.neutron [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Refreshing network info cache for port 039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG nova.network.neutron [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updated VIF entry in instance network info cache for port 039674ae-aa8d-4194-a82a-0522d98a3e94. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG nova.network.neutron [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updating instance_info_cache with network_info: [{"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Releasing lock "refresh_cache-62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:09 user nova-compute[74870]: INFO nova.compute.manager [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Terminating instance
Nov 28 07:03:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:03:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-vif-unplugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] No waiting events found dispatching network-vif-unplugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-vif-unplugged-039674ae-aa8d-4194-a82a-0522d98a3e94 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:03:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Instance destroyed successfully.
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'resources' on Instance uuid 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-985455269',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-985455269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-985455269',id=45,image_ref='9b35b5bc-a710-492d-93aa-ae06b4ac29b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3yEiDYiUs/P5zKldbzJkovtF3EfJjvSuKt4/cua9dAZ7JiOcjNDIYOsr3PpzJvb5uB9NS9ux76qjy+rXD0s67lGDl07aeLGETyT5WUfbmW7fYH0T2knTlco6MKFAF0OA==',key_name='tempest-keypair-966967716',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:01:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-wx78t1om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1541228194',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "039674ae-aa8d-4194-a82a-0522d98a3e94", "address": "fa:16:3e:0a:14:9a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039674ae-aa", "ovs_interfaceid": "039674ae-aa8d-4194-a82a-0522d98a3e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_vif [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap039674ae-aa, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7654f548-147c-45e1-a2dd-bd38da2df141) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:10 user nova-compute[74870]: INFO os_vif [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=039674ae-aa8d-4194-a82a-0522d98a3e94,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039674ae-aa')
Nov 28 07:03:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuCoEDpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[84002e09-8198-4415-89cd-978f141247be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:03:10 user nova-compute[74870]: No targets found.
Nov 28 07:03:10 user nova-compute[74870]: iSNS:
Nov 28 07:03:10 user nova-compute[74870]: No targets found.
Nov 28 07:03:10 user nova-compute[74870]: STATIC:
Nov 28 07:03:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b
Nov 28 07:03:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:03:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:03:10 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:03:10 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:03:10 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:03:10 user nova-compute[74870]: FIRMWARE:
Nov 28 07:03:10 user nova-compute[74870]: No targets found.
Nov 28 07:03:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:03:10 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:03:10 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5437765-bd7b-48b0-a00d-df85fdade561]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[929176ad-d1ca-4b22-9649-36fc22fc2722]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:10 user nova-compute[74870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b (non-flash)
Nov 28 07:03:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:10 user nova-compute[74870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b (non-flash)
Nov 28 07:03:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf003b6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6054b6-4ccf-4894-9cb4-29ea13bb3343]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd380386-b996-4026-b691-f12e20e4fbfb]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eccee4-5c02-4cd6-9d7e-42c0ad1827aa]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:03:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c4f01-8838-4a63-af3c-2cdcd02d4c22]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3006ee53', '/dev/disk/by-id/scsi-1SCST_BIO3006ee53-6788c30a36db4165', '/dev/disk/by-id/scsi-23637383863333061') {{(pid=85885) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4498b5-a5a6-4e8a-9683-160b08d47b2a]: (4, None) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca0d89-3b05-4839-96d6-6291ae515072]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc99ec63-9a3f-4636-b9e6-d763c8877a97]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260]
Nov 28 07:03:11 user nova-compute[74870]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b, portal: 172.16.0.220,3260] successful.
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf76225-a484-4ebf-b8df-50697f8b387b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2772d479-9fe1-4c04-8742-38d5dd8cde13]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== disconnect_volume: return (324ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:03:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Deleting instance files /opt/stack/data/nova/instances/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a_del
Nov 28 07:03:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Deletion of /opt/stack/data/nova/instances/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a_del complete
Nov 28 07:03:11 user nova-compute[74870]: INFO nova.compute.manager [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTSPifbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:11 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:11 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:11 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90086a9-b2d8-4fc5-9fb2-0bd5162fb04b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:03:11 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0abfea-9aca-4c19-923e-e1c1e204388a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318] added
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a60859f-fb84-4ab9-b658-6b3ba89478ab]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1820e7-6a7a-41ce-b9ff-35f3f27e4183]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTSPifbD {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTSPifbD" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b1f09-3da2-49a0-85ae-b76f6918950c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTSPifbD'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e21ee3-708c-4a1c-8eca-40506fc49dcc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e610506-379f-4095-9cc3-a5e5ffe38325]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd40fba2-2e1f-421c-9e85-4248eb7577dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260]
Nov 28 07:03:11 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260] successful.
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2707d6-efb1-44fd-b4b9-a7f7f5d67ace]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6c0852-69b6-42f8-9343-e118b9bba29b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:11 user nova-compute[74870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 (non-flash)
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:11 user nova-compute[74870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 (non-flash)
Nov 28 07:03:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[885590fa-897f-4093-af7f-ae8c416674e8]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:03:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTSPifbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:03:12 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Took 0.87 seconds to deallocate network for instance.
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Acquiring lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] No waiting events found dispatching network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:03:12 user nova-compute[74870]: WARNING nova.compute.manager [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received unexpected event network-vif-plugged-039674ae-aa8d-4194-a82a-0522d98a3e94 for instance with vm_state active and task_state deleting.
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.compute.manager [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Received event network-vif-deleted-039674ae-aa8d-4194-a82a-0522d98a3e94 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:12 user nova-compute[74870]: INFO nova.compute.manager [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Took 0.74 seconds to detach 1 volumes for instance.
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Deleting volume: cdf76225-a484-4ebf-b8df-50697f8b387b {{(pid=74870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26130316236353332', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130316236353332', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'flavor' on Instance uuid f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:03:12 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:03:12 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:03:12 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:03:12 user nova-compute[74870]:   <serial>a17dc5fd-07dd-4698-b421-981621d23318</serial>
Nov 28 07:03:12 user nova-compute[74870]: </disk>
Nov 28 07:03:12 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:13 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Deleted allocations for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a
Nov 28 07:03:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] No VIF found with MAC fa:16:3e:ce:f2:3c, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:03:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.033s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:03:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:03:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=25.278583526611328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 304574e5-b806-44dc-9302-cdce2822898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f69564a5-bf33-41a2-bc28-9bf7950be296 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:30 user nova-compute[74870]: INFO nova.compute.manager [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Detaching volume a17dc5fd-07dd-4698-b421-981621d23318
Nov 28 07:03:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:31 user nova-compute[74870]: INFO nova.virt.block_device [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Attempting to driver detach volume a17dc5fd-07dd-4698-b421-981621d23318 from mountpoint /dev/vdb
Nov 28 07:03:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Attempting to detach device vdb from instance f69564a5-bf33-41a2-bc28-9bf7950be296 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:03:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:03:31 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:03:31 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:03:31 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:03:31 user nova-compute[74870]:   <serial>a17dc5fd-07dd-4698-b421-981621d23318</serial>
Nov 28 07:03:31 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:03:31 user nova-compute[74870]: </disk>
Nov 28 07:03:31 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:03:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully detached device vdb from instance f69564a5-bf33-41a2-bc28-9bf7950be296 from the persistent domain config.
Nov 28 07:03:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f69564a5-bf33-41a2-bc28-9bf7950be296 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:03:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:03:31 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:03:31 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:03:31 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:03:31 user nova-compute[74870]:   <serial>a17dc5fd-07dd-4698-b421-981621d23318</serial>
Nov 28 07:03:31 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:03:31 user nova-compute[74870]: </disk>
Nov 28 07:03:31 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:03:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:03:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:03:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Skipping network cache update for instance because it is being deleted. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 28 07:03:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 07:03:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:03:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:03:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:03:46 user nova-compute[74870]: INFO nova.compute.claims [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Claim successful on node user
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:03:46 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.policy [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:03:46 user nova-compute[74870]: INFO nova.virt.block_device [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Booting with volume b5ec27cc-cec3-483f-8d88-6568e398a02e at /dev/vda
Nov 28 07:03:46 user nova-compute[74870]: DEBUG os_brick.utils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a0f958-7b55-478f-aaf2-69e92b36898a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7073c68-a10d-478e-a8a6-6aecbc47968e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f12949-e7e2-47d4-a3b2-acff1587921a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cc789a-b617-4f5e-a3e7-844836e9af60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:03:46 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:03:46 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16064c6e-7efd-4d8d-b3f7-546eab1cc8da]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG os_brick.utils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:46 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating existing volume attachment record: a4e48a50-9a8c-48a8-abd8-fb9b579a155f {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Successfully created port: 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Successfully updated port: 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG nova.compute.manager [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing instance network info cache due to event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:03:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance network_info: |[{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG nova.network.neutron [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG nova.network.neutron [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated VIF entry in instance network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG nova.network.neutron [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:03:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:03:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:51 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f69564a5-bf33-41a2-bc28-9bf7950be296 is timed out.
Nov 28 07:03:51 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully detached device vdb from instance f69564a5-bf33-41a2-bc28-9bf7950be296 from the live domain config.
Nov 28 07:03:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTSPifbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:51 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f778e7-ff1a-4016-8900-90ccfc121aeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:03:51 user nova-compute[74870]: No targets found.
Nov 28 07:03:51 user nova-compute[74870]: iSNS:
Nov 28 07:03:51 user nova-compute[74870]: No targets found.
Nov 28 07:03:51 user nova-compute[74870]: STATIC:
Nov 28 07:03:51 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318
Nov 28 07:03:51 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:03:51 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:03:51 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:03:51 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:03:51 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:03:51 user nova-compute[74870]: FIRMWARE:
Nov 28 07:03:51 user nova-compute[74870]: No targets found.
Nov 28 07:03:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:03:51 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:03:51 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7789758-1ce5-4422-99e3-0e840b446bdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c76cc8b-09f0-4973-9ef6-8b6a551680eb]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:51 user nova-compute[74870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 (non-flash)
Nov 28 07:03:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:51 user nova-compute[74870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 (non-flash)
Nov 28 07:03:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc127910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee86d3-bac5-4bae-a5a7-6c7ce57f2451]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1728d-14c1-4cf8-b5b4-41e4c0c3d411]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d218f5d2-c518-444e-a98f-52153359d2cb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad46b1-f66e-46a6-9625-5371261c734d]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea2d0ca-9461-4cf1-961a-b7560357b409]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6733742-6de3-49f6-8877-5c3c7acb163d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260]
Nov 28 07:03:51 user nova-compute[74870]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318, portal: 172.16.0.220,3260] successful.
Nov 28 07:03:51 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa83956-4214-478d-b2e2-a339e0d65314]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== disconnect_volume: return (302ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:51 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'flavor' on Instance uuid f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.758s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.611s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:52 user nova-compute[74870]: INFO nova.compute.manager [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Terminating instance
Nov 28 07:03:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-vif-unplugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] No waiting events found dispatching network-vif-unplugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:03:52 user nova-compute[74870]: DEBUG nova.compute.manager [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-vif-unplugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:03:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Creating image(s)
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Ensure instance console log exists: /opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Start _get_guest_xml network_info=[{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a69c84f-a030-4262-8f84-7d4bd72db3fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5ec27cc-cec3-483f-8d88-6568e398a02e', 'serial': 'b5ec27cc-cec3-483f-8d88-6568e398a02e'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'a4e48a50-9a8c-48a8-abd8-fb9b579a155f', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:03:53 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:03:53 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:53 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[752088ca-51fb-4b56-857d-c5e44bd6b717]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:03:53 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cdcc26-70ed-43ca-a08b-eea6781282c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e] added
Nov 28 07:03:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Instance destroyed successfully.
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'resources' on Instance uuid f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-187360494',display_name='tempest-VolumesSnapshotTestJSON-instance-187360494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-187360494',id=44,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILnZ2bSYD7C7qQpY3V/IJDltBTIc6Dlzb+LlSUgAknlnhIs7hnELxdz9TrmSJPvyqkS7nZGtlgdt6xLyjIWPLsz31+3N20PY9yNf3/tdKzT6WIf/5v0Co0KV5lMCJu2/A==',key_name='tempest-keypair-74843823',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:01:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82be9b17ed614b8aa2bb7172eedf516e',ramdisk_id='',reservation_id='r-hsa9c8ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-719548845',owner_user_name='tempest-VolumesSnapshotTestJSON-719548845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eb76cab93f4dfd97bf85828d89df68',uuid=f69564a5-bf33-41a2-bc28-9bf7950be296,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converting VIF {"id": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "address": "fa:16:3e:ce:f2:3c", "network": {"id": "e362119a-300d-496b-a211-8b1a13b2edf8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1768971989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82be9b17ed614b8aa2bb7172eedf516e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e515013-11", "ovs_interfaceid": "6e515013-115b-4ad7-9ffb-f4aebd5cca06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_vif [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d2253-2fdd-4673-87c1-bdc14dc94406]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e515013-11, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66e9d059-e2a1-46a3-9838-9a60833e7d2f) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:53 user nova-compute[74870]: INFO os_vif [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e515013-115b-4ad7-9ffb-f4aebd5cca06,network=Network(e362119a-300d-496b-a211-8b1a13b2edf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e515013-11')
Nov 28 07:03:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTSPifbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:03:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e0521-baaa-4384-9c64-0236a381a0b9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXlCrNzc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXlCrNzc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce07e6d-0e1a-4ded-81b5-3607f1ac7d8f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXlCrNzc'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96061b6b-66ff-4867-adee-4bd62e4b2ba6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3eb1b-80b8-4299-af36-a59d2bc0f569]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da639038-7bbe-4eda-8b8a-94d00c5e1301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]
Nov 28 07:03:53 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.
Nov 28 07:03:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a0fce-e039-4997-a96a-719ef14cf5e2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae843d21-83c2-40b4-84bd-779bcd121188]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:53 user nova-compute[74870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:03:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:53 user nova-compute[74870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:03:53 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab77a91-99c2-4b17-8f80-8c5743e78e54]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:03:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23762353130346235', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762353130346235', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.207s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a6e01f-5d25-4c32-947e-908eb61b59db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:03:54 user nova-compute[74870]: No targets found.
Nov 28 07:03:54 user nova-compute[74870]: iSNS:
Nov 28 07:03:54 user nova-compute[74870]: No targets found.
Nov 28 07:03:54 user nova-compute[74870]: STATIC:
Nov 28 07:03:54 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e
Nov 28 07:03:54 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:03:54 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:03:54 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:03:54 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:03:54 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:03:54 user nova-compute[74870]: FIRMWARE:
Nov 28 07:03:54 user nova-compute[74870]: No targets found.
Nov 28 07:03:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:03:54 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:03:54 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17dc5fd-07dd-4698-b421-981621d23318', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945636414',display_name='tempest-TestShelveInstance-server-945636414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945636414',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/8TK0s6S6jr6eVoVISilIkFNISMDUr3k40yMWuPUApm+U40gTGbmzKNum2DQ1fk//z2lD/tCVOMz+xgbRbztjSm+nTNW4EUfhK5oA+KcwC8c2v28/4DXqA2z9nZAmGbw==',key_name='tempest-TestShelveInstance-1887206196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f9fb47f7da246f9b569ca12206c5726',ramdisk_id='',reservation_id='r-wm7z698x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1756841419',owner_user_name='tempest-TestShelveInstance-1756841419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:03:46Z,user_data=None,user_id='a54dae1189f7405eb8b8b1aefe0b6ce7',uuid=6a69c84f-a030-4262-8f84-7d4bd72db3fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converting VIF {"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:03:54 user nova-compute[74870]:   <uuid>6a69c84f-a030-4262-8f84-7d4bd72db3fe</uuid>
Nov 28 07:03:54 user nova-compute[74870]:   <name>instance-0000002e</name>
Nov 28 07:03:54 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:03:54 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:03:54 user nova-compute[74870]:   <metadata>
Nov 28 07:03:54 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:03:54 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:03:54 user nova-compute[74870]:       <nova:name>tempest-TestShelveInstance-server-945636414</nova:name>
Nov 28 07:03:54 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:03:53</nova:creationTime>
Nov 28 07:03:54 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:03:54 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:03:54 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:03:54 user nova-compute[74870]:       <nova:owner>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:user uuid="a54dae1189f7405eb8b8b1aefe0b6ce7">tempest-TestShelveInstance-1756841419-project-member</nova:user>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:project uuid="8f9fb47f7da246f9b569ca12206c5726">tempest-TestShelveInstance-1756841419</nova:project>
Nov 28 07:03:54 user nova-compute[74870]:       </nova:owner>
Nov 28 07:03:54 user nova-compute[74870]:       <nova:ports>
Nov 28 07:03:54 user nova-compute[74870]:         <nova:port uuid="3edba92c-a2b6-485d-985d-00a244d7207f">
Nov 28 07:03:54 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 07:03:54 user nova-compute[74870]:         </nova:port>
Nov 28 07:03:54 user nova-compute[74870]:       </nova:ports>
Nov 28 07:03:54 user nova-compute[74870]:     </nova:instance>
Nov 28 07:03:54 user nova-compute[74870]:   </metadata>
Nov 28 07:03:54 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:03:54 user nova-compute[74870]:     <system>
Nov 28 07:03:54 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:03:54 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:03:54 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:03:54 user nova-compute[74870]:       <entry name="serial">6a69c84f-a030-4262-8f84-7d4bd72db3fe</entry>
Nov 28 07:03:54 user nova-compute[74870]:       <entry name="uuid">6a69c84f-a030-4262-8f84-7d4bd72db3fe</entry>
Nov 28 07:03:54 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:03:54 user nova-compute[74870]:     </system>
Nov 28 07:03:54 user nova-compute[74870]:   </sysinfo>
Nov 28 07:03:54 user nova-compute[74870]:   <os>
Nov 28 07:03:54 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:03:54 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:03:54 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:03:54 user nova-compute[74870]:   </os>
Nov 28 07:03:54 user nova-compute[74870]:   <features>
Nov 28 07:03:54 user nova-compute[74870]:     <acpi/>
Nov 28 07:03:54 user nova-compute[74870]:     <apic/>
Nov 28 07:03:54 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:03:54 user nova-compute[74870]:   </features>
Nov 28 07:03:54 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:03:54 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:03:54 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:03:54 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:03:54 user nova-compute[74870]:   </clock>
Nov 28 07:03:54 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:03:54 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:03:54 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:03:54 user nova-compute[74870]:   </cpu>
Nov 28 07:03:54 user nova-compute[74870]:   <devices>
Nov 28 07:03:54 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:03:54 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:03:54 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 07:03:54 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:03:54 user nova-compute[74870]:       <serial>b5ec27cc-cec3-483f-8d88-6568e398a02e</serial>
Nov 28 07:03:54 user nova-compute[74870]:     </disk>
Nov 28 07:03:54 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:03:54 user nova-compute[74870]:       <mac address="fa:16:3e:62:86:57"/>
Nov 28 07:03:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:03:54 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:03:54 user nova-compute[74870]:       <target dev="tap3edba92c-a2"/>
Nov 28 07:03:54 user nova-compute[74870]:     </interface>
Nov 28 07:03:54 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:03:54 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe/console.log" append="off"/>
Nov 28 07:03:54 user nova-compute[74870]:     </serial>
Nov 28 07:03:54 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:03:54 user nova-compute[74870]:     <video>
Nov 28 07:03:54 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:03:54 user nova-compute[74870]:     </video>
Nov 28 07:03:54 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:03:54 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:03:54 user nova-compute[74870]:     </rng>
Nov 28 07:03:54 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:03:54 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:03:54 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:03:54 user nova-compute[74870]:     </memballoon>
Nov 28 07:03:54 user nova-compute[74870]:   </devices>
Nov 28 07:03:54 user nova-compute[74870]: </domain>
Nov 28 07:03:54 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945636414',display_name='tempest-TestShelveInstance-server-945636414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945636414',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/8TK0s6S6jr6eVoVISilIkFNISMDUr3k40yMWuPUApm+U40gTGbmzKNum2DQ1fk//z2lD/tCVOMz+xgbRbztjSm+nTNW4EUfhK5oA+KcwC8c2v28/4DXqA2z9nZAmGbw==',key_name='tempest-TestShelveInstance-1887206196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f9fb47f7da246f9b569ca12206c5726',ramdisk_id='',reservation_id='r-wm7z698x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1756841419',owner_user_name='tempest-TestShelveInstance-1756841419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:03:46Z,user_data=None,user_id='a54dae1189f7405eb8b8b1aefe0b6ce7',uuid=6a69c84f-a030-4262-8f84-7d4bd72db3fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converting VIF {"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_vif [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5719ce47-f001-4961-957e-e1df1e7613e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4da8f552-cf36-5ac8-9216-908e6d8a7dfc', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3edba92c-a2, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3edba92c-a2, col_values=(('qos', UUID('b9c1047d-f06f-48b0-b4ef-7f4bd4f22a1c')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3edba92c-a2, col_values=(('external_ids', {'iface-id': '3edba92c-a2b6-485d-985d-00a244d7207f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:86:57', 'vm-uuid': '6a69c84f-a030-4262-8f84-7d4bd72db3fe'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:54 user nova-compute[74870]: INFO os_vif [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2')
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec4d707-fe2b-4678-bb98-24d22df4fec8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:54 user nova-compute[74870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:03:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:03:54 user nova-compute[74870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:03:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc325000>, {}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Disconnecting from: [] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] <== disconnect_volume: return (1281ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:03:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Deleting instance files /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296_del
Nov 28 07:03:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Deletion of /opt/stack/data/nova/instances/f69564a5-bf33-41a2-bc28-9bf7950be296_del complete
Nov 28 07:03:54 user nova-compute[74870]: INFO nova.compute.manager [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Took 2.15 seconds to destroy the instance on the hypervisor.
Nov 28 07:03:54 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:03:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] No VIF found with MAC fa:16:3e:62:86:57, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:03:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Acquiring lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] No waiting events found dispatching network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:03:55 user nova-compute[74870]: WARNING nova.compute.manager [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received unexpected event network-vif-plugged-6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance with vm_state active and task_state deleting.
Nov 28 07:03:56 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:56 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Took 1.21 seconds to deallocate network for instance.
Nov 28 07:03:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:56 user nova-compute[74870]: WARNING nova.volume.cinder [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Attachment 7a57a85b-b210-4981-855f-171560f77c41 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7a57a85b-b210-4981-855f-171560f77c41. (HTTP 404) (Request-ID: req-7e0bdcbd-440f-4083-95f1-e25d2dd3fb81)
Nov 28 07:03:56 user nova-compute[74870]: INFO nova.compute.manager [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 07:03:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Received event network-vif-deleted-6e515013-115b-4ad7-9ffb-f4aebd5cca06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:03:56 user nova-compute[74870]: WARNING nova.compute.manager [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state building and task_state spawning.
Nov 28 07:03:56 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:56 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Deleted allocations for instance f69564a5-bf33-41a2-bc28-9bf7950be296
Nov 28 07:03:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "f69564a5-bf33-41a2-bc28-9bf7950be296" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:03:58 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance spawned successfully.
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:03:58 user nova-compute[74870]: INFO nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:03:58 user nova-compute[74870]: WARNING nova.compute.manager [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state active and task_state None.
Nov 28 07:03:58 user nova-compute[74870]: INFO nova.compute.manager [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Took 12.29 seconds to build instance.
Nov 28 07:03:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.382s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:03:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:03:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "304574e5-b806-44dc-9302-cdce2822898f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:03 user nova-compute[74870]: INFO nova.compute.manager [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Terminating instance
Nov 28 07:04:03 user nova-compute[74870]: DEBUG nova.compute.manager [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-vif-unplugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] No waiting events found dispatching network-vif-unplugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-vif-unplugged-3eb0757a-68b5-4718-b270-812c217e9e86 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:04:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Instance destroyed successfully.
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'resources' on Instance uuid 304574e5-b806-44dc-9302-cdce2822898f {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T06:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1208701007',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1208701007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1208701007',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw/bgJM7S7KTViraEzpff75LdAz+7XKA3V0OajZokvNlT8+UF+rFN68SYhnsA4uQlPYo6UuoIvnVGIHXMcO6dX9mYxRXnFeRY818AlVAV+XmpPx5B1+yb6wwqL2D5PHwg==',key_name='tempest-keypair-6317093',keypairs=<?>,launch_index=0,launched_at=2023-11-28T06:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-zj121k9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T06:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=304574e5-b806-44dc-9302-cdce2822898f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "3eb0757a-68b5-4718-b270-812c217e9e86", "address": "fa:16:3e:98:16:2a", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb0757a-68", "ovs_interfaceid": "3eb0757a-68b5-4718-b270-812c217e9e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_vif [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb0757a-68, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71d9d562-7d56-4058-89c7-496de1a2bc03) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:04:04 user nova-compute[74870]: INFO os_vif [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:16:2a,bridge_name='br-int',has_traffic_filtering=True,id=3eb0757a-68b5-4718-b270-812c217e9e86,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb0757a-68')
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXOWGSxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:04:04 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285e7f3-887e-4955-964d-8b97aeb91277]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:04:04 user nova-compute[74870]: No targets found.
Nov 28 07:04:04 user nova-compute[74870]: iSNS:
Nov 28 07:04:04 user nova-compute[74870]: No targets found.
Nov 28 07:04:04 user nova-compute[74870]: STATIC:
Nov 28 07:04:04 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e
Nov 28 07:04:04 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:04:04 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:04:04 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235
Nov 28 07:04:04 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:04:04 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:04:04 user nova-compute[74870]: FIRMWARE:
Nov 28 07:04:04 user nova-compute[74870]: No targets found.
Nov 28 07:04:04 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:04:04 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:04:04 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3f7286-8976-4ab9-a434-683c0da49e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[551aa4fe-e30f-4d79-98c6-bbafbf03c4a7]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:04:04 user nova-compute[74870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:04:04 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 (non-flash)
Nov 28 07:04:04 user nova-compute[74870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:04:04 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef4140670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3adc04-edea-4166-8633-20096deddf94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18652045-4eec-40a7-980a-abd2a3a817cf]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5be472-ad37-4c8c-b95e-7337b95c5b9e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05114b6a-fc5d-43bd-9218-3f7901ce62b9]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a709a62-d03c-4f50-954f-cbf3e16c2e6d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db16d4c-19d4-4bb1-a735-898ea7ba85ef]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260]
Nov 28 07:04:04 user nova-compute[74870]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235, portal: 172.16.0.220,3260] successful.
Nov 28 07:04:04 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed591127-ee7f-497d-9cfc-4cd2e691c235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c636c9-99d7-40ab-a643-acf954035ec8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== disconnect_volume: return (283ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:04:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Deleting instance files /opt/stack/data/nova/instances/304574e5-b806-44dc-9302-cdce2822898f_del
Nov 28 07:04:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Deletion of /opt/stack/data/nova/instances/304574e5-b806-44dc-9302-cdce2822898f_del complete
Nov 28 07:04:04 user nova-compute[74870]: INFO nova.compute.manager [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 07:04:04 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:04:04 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 304574e5-b806-44dc-9302-cdce2822898f] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:04:05 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:04:05 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Took 0.78 seconds to deallocate network for instance.
Nov 28 07:04:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Acquiring lock "304574e5-b806-44dc-9302-cdce2822898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Lock "304574e5-b806-44dc-9302-cdce2822898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] No waiting events found dispatching network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:04:06 user nova-compute[74870]: WARNING nova.compute.manager [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received unexpected event network-vif-plugged-3eb0757a-68b5-4718-b270-812c217e9e86 for instance with vm_state active and task_state deleting.
Nov 28 07:04:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Received event network-vif-deleted-3eb0757a-68b5-4718-b270-812c217e9e86 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:04:06 user nova-compute[74870]: INFO nova.compute.manager [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Took 0.72 seconds to detach 1 volumes for instance.
Nov 28 07:04:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Deleting volume: ed591127-ee7f-497d-9cfc-4cd2e691c235 {{(pid=74870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:06 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Deleted allocations for instance 304574e5-b806-44dc-9302-cdce2822898f
Nov 28 07:04:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "304574e5-b806-44dc-9302-cdce2822898f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.101s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:28 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:29 user nova-compute[74870]: INFO nova.compute.manager [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Terminating instance
Nov 28 07:04:29 user nova-compute[74870]: DEBUG nova.compute.manager [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-unplugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-unplugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:04:29 user nova-compute[74870]: DEBUG nova.compute.manager [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-unplugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Instance destroyed successfully.
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'resources' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T06:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1985880305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1985880305',id=42,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPwnK6lmjMoJybvl5cVU2MnwVHXFMNeaO8Rsnt98BjuMQVUOleaBJRxeVYQX7a8iMW/3nZ6jmfwOilHW6nIAGbi0+22NgwmT8lUhLxagB/l+ms7V0NW840WRlnEpKPZA==',key_name='tempest-keypair-1691834733',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d769a1c976c468f804770d89c92ae94',ramdisk_id='',reservation_id='r-0tb0vdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-92318211',owner_user_name='tempest-AttachVolumeShelveTestJSON-92318211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf659ad4b8f43a2bc497d01be58d846',uuid=57d4327e-1732-4e71-be0d-05ae08e312b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converting VIF {"id": "b8282f0c-783f-4279-b530-d188e9b43e49", "address": "fa:16:3e:b6:2b:ed", "network": {"id": "33d7ba92-eb3a-4951-905c-54f3d9532751", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-660364732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d769a1c976c468f804770d89c92ae94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8282f0c-78", "ovs_interfaceid": "b8282f0c-783f-4279-b530-d188e9b43e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG os_vif [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8282f0c-78, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=810112a1-648c-455b-bd3a-5b0c05e21a70) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:04:30 user nova-compute[74870]: INFO os_vif [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:2b:ed,bridge_name='br-int',has_traffic_filtering=True,id=b8282f0c-783f-4279-b530-d188e9b43e49,network=Network(33d7ba92-eb3a-4951-905c-54f3d9532751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8282f0c-78')
Nov 28 07:04:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Deleting instance files /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5_del
Nov 28 07:04:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Deletion of /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5_del complete
Nov 28 07:04:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002a, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/57d4327e-1732-4e71-be0d-05ae08e312b5/disk
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:04:30 user nova-compute[74870]: INFO nova.compute.manager [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:04:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:04:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:04:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.302989959716797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:04:31 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Took 0.73 seconds to deallocate network for instance.
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-deleted-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:31 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Deleted allocations for instance 57d4327e-1732-4e71-be0d-05ae08e312b5
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Acquiring lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:31 user nova-compute[74870]: DEBUG nova.compute.manager [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] No waiting events found dispatching network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:04:31 user nova-compute[74870]: WARNING nova.compute.manager [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Received unexpected event network-vif-plugged-b8282f0c-783f-4279-b530-d188e9b43e49 for instance with vm_state deleted and task_state None.
Nov 28 07:04:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "57d4327e-1732-4e71-be0d-05ae08e312b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.408s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 07:04:32 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 07:04:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:33 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 07:04:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:04:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:04:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:04:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:04:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:04:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:04:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:04:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 07:04:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:04:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:04:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:04:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:05:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "f112048f-4224-409f-bb75-63eb252c6097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:05:04 user nova-compute[74870]: INFO nova.compute.claims [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Claim successful on node user
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:05:04 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG nova.policy [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:05:04 user nova-compute[74870]: INFO nova.virt.block_device [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Booting with volume fba423b6-1127-46d5-a9a7-87dd41849861 at /dev/vda
Nov 28 07:05:04 user nova-compute[74870]: DEBUG os_brick.utils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8436a-ac8b-4cc0-9f8a-042040d7b6d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb80d3-9f85-4737-84dd-1cc0470d9853]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[298838af-a7d6-4a86-a9cf-bb6ae712bead]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3956e6fc-2dc8-481f-9c99-1d688b6d87da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:05:04 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:05:05 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:05:05 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3825cbc5-4358-4217-b05c-cee0d35ebc9f]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG os_brick.utils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updating existing volume attachment record: 08a20365-0554-48ba-b7f6-046bb6e15c73 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Successfully created port: 1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:05:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Successfully updated port: 1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquired lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-changed-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Refreshing instance network info cache due to event network-changed-1b92c19d-d039-4173-97fc-8d84aed4a840. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Acquiring lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updating instance_info_cache with network_info: [{"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Releasing lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Instance network_info: |[{"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Acquired lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Refreshing network info cache for port 1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updated VIF entry in instance network info cache for port 1b92c19d-d039-4173-97fc-8d84aed4a840. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG nova.network.neutron [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updating instance_info_cache with network_info: [{"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:05:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Releasing lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:05:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:05:11 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Creating image(s)
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Ensure instance console log exists: /opt/stack/data/nova/instances/f112048f-4224-409f-bb75-63eb252c6097/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Start _get_guest_xml network_info=[{"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f112048f-4224-409f-bb75-63eb252c6097', 'attached_at': '', 'detached_at': '', 'volume_id': 'fba423b6-1127-46d5-a9a7-87dd41849861', 'serial': 'fba423b6-1127-46d5-a9a7-87dd41849861'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '08a20365-0554-48ba-b7f6-046bb6e15c73', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:05:11 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:05:11 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:05:11 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:05:11 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:05:11 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c5721-e1fd-481d-afda-1e3f31601b17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:05:11 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b247f2-62a4-4be6-aab3-5a854fcdd3ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861] added
Nov 28 07:05:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[93901417-9f2e-4b48-bc52-2e69ad4d2a84]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637a475-dafa-4e19-9012-7b8a1461f463]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJPmqnuW {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJPmqnuW" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337ec3f-be6e-45fb-8340-6c78ca60e276]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJPmqnuW'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da39317-7b91-4569-93b4-1b5f3ddb295f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5cfcb0-d226-403b-8fec-06c69f781ce2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:05:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:05:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5aaf9e-b97b-4f7b-a20c-664148bd4786]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]
Nov 28 07:05:11 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.
Nov 28 07:05:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d4b5ef-31db-49c4-ad4d-13835f8a03e0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddc0309-1890-4b7f-be29-12530fd1b3b9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:05:11 user nova-compute[74870]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:05:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:05:11 user nova-compute[74870]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:05:11 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ac65c-5fd9-4ff3-a0cf-64cc9cf845dc]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23939346465643562', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939346465643562', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-897983027',display_name='tempest-TestVolumeBootPattern-server-897983027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-897983027',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-0g5cxsyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:05:05Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=f112048f-4224-409f-bb75-63eb252c6097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'pci_devices' on Instance uuid f112048f-4224-409f-bb75-63eb252c6097 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:05:12 user nova-compute[74870]:   <uuid>f112048f-4224-409f-bb75-63eb252c6097</uuid>
Nov 28 07:05:12 user nova-compute[74870]:   <name>instance-0000002f</name>
Nov 28 07:05:12 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:05:12 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:05:12 user nova-compute[74870]:   <metadata>
Nov 28 07:05:12 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:05:12 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:05:12 user nova-compute[74870]:       <nova:name>tempest-TestVolumeBootPattern-server-897983027</nova:name>
Nov 28 07:05:12 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:05:11</nova:creationTime>
Nov 28 07:05:12 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:05:12 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:05:12 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:05:12 user nova-compute[74870]:       <nova:owner>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:user uuid="2139976b453e4bd2b8e83e551a0cc772">tempest-TestVolumeBootPattern-1541228194-project-member</nova:user>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:project uuid="cecfa8e54acf42a8affd8686f500d6c9">tempest-TestVolumeBootPattern-1541228194</nova:project>
Nov 28 07:05:12 user nova-compute[74870]:       </nova:owner>
Nov 28 07:05:12 user nova-compute[74870]:       <nova:ports>
Nov 28 07:05:12 user nova-compute[74870]:         <nova:port uuid="1b92c19d-d039-4173-97fc-8d84aed4a840">
Nov 28 07:05:12 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 07:05:12 user nova-compute[74870]:         </nova:port>
Nov 28 07:05:12 user nova-compute[74870]:       </nova:ports>
Nov 28 07:05:12 user nova-compute[74870]:     </nova:instance>
Nov 28 07:05:12 user nova-compute[74870]:   </metadata>
Nov 28 07:05:12 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:05:12 user nova-compute[74870]:     <system>
Nov 28 07:05:12 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:05:12 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:05:12 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:05:12 user nova-compute[74870]:       <entry name="serial">f112048f-4224-409f-bb75-63eb252c6097</entry>
Nov 28 07:05:12 user nova-compute[74870]:       <entry name="uuid">f112048f-4224-409f-bb75-63eb252c6097</entry>
Nov 28 07:05:12 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:05:12 user nova-compute[74870]:     </system>
Nov 28 07:05:12 user nova-compute[74870]:   </sysinfo>
Nov 28 07:05:12 user nova-compute[74870]:   <os>
Nov 28 07:05:12 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:05:12 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:05:12 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:05:12 user nova-compute[74870]:   </os>
Nov 28 07:05:12 user nova-compute[74870]:   <features>
Nov 28 07:05:12 user nova-compute[74870]:     <acpi/>
Nov 28 07:05:12 user nova-compute[74870]:     <apic/>
Nov 28 07:05:12 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:05:12 user nova-compute[74870]:   </features>
Nov 28 07:05:12 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:05:12 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:05:12 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:05:12 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:05:12 user nova-compute[74870]:   </clock>
Nov 28 07:05:12 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:05:12 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:05:12 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:05:12 user nova-compute[74870]:   </cpu>
Nov 28 07:05:12 user nova-compute[74870]:   <devices>
Nov 28 07:05:12 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:05:12 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:05:12 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 07:05:12 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:05:12 user nova-compute[74870]:       <serial>fba423b6-1127-46d5-a9a7-87dd41849861</serial>
Nov 28 07:05:12 user nova-compute[74870]:     </disk>
Nov 28 07:05:12 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:05:12 user nova-compute[74870]:       <mac address="fa:16:3e:94:95:fb"/>
Nov 28 07:05:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:05:12 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:05:12 user nova-compute[74870]:       <target dev="tap1b92c19d-d0"/>
Nov 28 07:05:12 user nova-compute[74870]:     </interface>
Nov 28 07:05:12 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:05:12 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/f112048f-4224-409f-bb75-63eb252c6097/console.log" append="off"/>
Nov 28 07:05:12 user nova-compute[74870]:     </serial>
Nov 28 07:05:12 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:05:12 user nova-compute[74870]:     <video>
Nov 28 07:05:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:05:12 user nova-compute[74870]:     </video>
Nov 28 07:05:12 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:05:12 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:05:12 user nova-compute[74870]:     </rng>
Nov 28 07:05:12 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:05:12 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:05:12 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:05:12 user nova-compute[74870]:     </memballoon>
Nov 28 07:05:12 user nova-compute[74870]:   </devices>
Nov 28 07:05:12 user nova-compute[74870]: </domain>
Nov 28 07:05:12 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-897983027',display_name='tempest-TestVolumeBootPattern-server-897983027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-897983027',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-0g5cxsyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:05:05Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=f112048f-4224-409f-bb75-63eb252c6097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG os_vif [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f808182-7c49-5650-8a1d-03c4437d5deb', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b92c19d-d0, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b92c19d-d0, col_values=(('qos', UUID('d4ed64e8-f06f-4d84-930d-eb7699e41eae')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b92c19d-d0, col_values=(('external_ids', {'iface-id': '1b92c19d-d039-4173-97fc-8d84aed4a840', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:95:fb', 'vm-uuid': 'f112048f-4224-409f-bb75-63eb252c6097'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:13 user nova-compute[74870]: INFO os_vif [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0')
Nov 28 07:05:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:05:13 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No VIF found with MAC fa:16:3e:94:95:fb, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:05:14 user nova-compute[74870]: WARNING nova.compute.manager [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received unexpected event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with vm_state building and task_state spawning.
Nov 28 07:05:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:05:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: f112048f-4224-409f-bb75-63eb252c6097] Instance spawned successfully.
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:05:16 user nova-compute[74870]: WARNING nova.compute.manager [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received unexpected event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with vm_state building and task_state spawning.
Nov 28 07:05:16 user nova-compute[74870]: INFO nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 28 07:05:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:05:16 user nova-compute[74870]: INFO nova.compute.manager [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Took 12.42 seconds to build instance.
Nov 28 07:05:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "f112048f-4224-409f-bb75-63eb252c6097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.508s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:27 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:05:30 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=25.319808959960938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f112048f-4224-409f-bb75-63eb252c6097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 07:05:30 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 07:05:31 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:05:31 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:05:31 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:05:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing instance network info cache due to event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated VIF entry in instance network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:38 user nova-compute[74870]: INFO nova.compute.manager [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Shelve offloading
Nov 28 07:05:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-unplugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-unplugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:05:39 user nova-compute[74870]: WARNING nova.compute.manager [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-unplugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state active and task_state shelving.
Nov 28 07:05:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance destroyed successfully.
Nov 28 07:05:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:05:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:05:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance destroyed successfully.
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'resources' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945636414',display_name='tempest-TestShelveInstance-server-945636414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945636414',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/8TK0s6S6jr6eVoVISilIkFNISMDUr3k40yMWuPUApm+U40gTGbmzKNum2DQ1fk//z2lD/tCVOMz+xgbRbztjSm+nTNW4EUfhK5oA+KcwC8c2v28/4DXqA2z9nZAmGbw==',key_name='tempest-TestShelveInstance-1887206196',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:03:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f9fb47f7da246f9b569ca12206c5726',ramdisk_id='',reservation_id='r-wm7z698x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1756841419',owner_user_name='tempest-TestShelveInstance-1756841419-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:03:58Z,user_data=None,user_id='a54dae1189f7405eb8b8b1aefe0b6ce7',uuid=6a69c84f-a030-4262-8f84-7d4bd72db3fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converting VIF {"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_vif [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3edba92c-a2, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9c1047d-f06f-48b0-b4ef-7f4bd4f22a1c) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing instance network info cache due to event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:05:40 user nova-compute[74870]: INFO os_vif [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2')
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:05:40 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5184432c-7419-473f-a6a5-8258338e5117]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:05:40 user nova-compute[74870]: No targets found.
Nov 28 07:05:40 user nova-compute[74870]: iSNS:
Nov 28 07:05:40 user nova-compute[74870]: No targets found.
Nov 28 07:05:40 user nova-compute[74870]: STATIC:
Nov 28 07:05:40 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e
Nov 28 07:05:40 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:05:40 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:05:40 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:05:40 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:05:40 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:05:40 user nova-compute[74870]: FIRMWARE:
Nov 28 07:05:40 user nova-compute[74870]: No targets found.
Nov 28 07:05:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:05:40 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:05:40 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a836dba6-699a-4746-a954-beb4a080ec58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5878b204-789e-4a5b-b59c-0c05f8bf7e69]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:05:40 user nova-compute[74870]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:05:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:05:40 user nova-compute[74870]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:05:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc604a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde05b0-8d4f-4bae-b4db-eaee70ffcc5d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2318ba5-a102-4d0f-9dd9-ae837404a114]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f86cc7-634a-48a3-af98-e9a12f43fe5d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[953af930-588d-4962-8e73-b8767399e685]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aeb5e8-3691-4253-93fc-dfb8bd848538]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed4b3a-4362-4ff7-ad4a-da593f7d7d13]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]
Nov 28 07:05:40 user nova-compute[74870]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.
Nov 28 07:05:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[be619dcb-64e2-44bf-b305-728e0d615695]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] <== disconnect_volume: return (314ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:05:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Deleting instance files /opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe_del
Nov 28 07:05:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Deletion of /opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe_del complete
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated VIF entry in instance network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:05:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": null, "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3edba92c-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:05:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:05:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:05:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:05:41 user nova-compute[74870]: WARNING nova.compute.manager [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state active and task_state shelving.
Nov 28 07:05:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:05:42 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Deleted allocations for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe
Nov 28 07:05:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG nova.objects.instance [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG nova.objects.base [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Object Instance<6a69c84f-a030-4262-8f84-7d4bd72db3fe> lazy-loaded attributes: resources,numa_topology {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.918s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:05:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:05:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:06:14 user nova-compute[74870]: INFO nova.compute.claims [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Claim successful on node user
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:06:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.policy [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:06:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Creating image(s)
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "54398da752d8dcac0a9e2c7766574b69449fb72e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "54398da752d8dcac0a9e2c7766574b69449fb72e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG nova.virt.images [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] d3a1e6c9-018f-495e-8204-f598e626c948 was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.part /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:15 user nova-compute[74870]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Successfully created port: 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.part /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.converted" returned: 0 in 0.364s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "54398da752d8dcac0a9e2c7766574b69449fb72e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.233s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Successfully updated port: 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing instance network info cache due to event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "54398da752d8dcac0a9e2c7766574b69449fb72e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "54398da752d8dcac0a9e2c7766574b69449fb72e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e,backing_fmt=raw /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e,backing_fmt=raw /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk 1073741824" returned: 0 in 0.069s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "54398da752d8dcac0a9e2c7766574b69449fb72e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance network_info: |[{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.network.neutron [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 07:06:16 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Cannot resize image /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Ensure instance console log exists: /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Start _get_guest_xml network_info=[{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T07:06:11Z,direct_url=<?>,disk_format='qcow2',id=d3a1e6c9-018f-495e-8204-f598e626c948,min_disk=0,min_ram=0,name='tempest-scenario-img--2019340017',owner='3af4e4870f934158819e183bbc7b499e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T07:06:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'd3a1e6c9-018f-495e-8204-f598e626c948'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:06:17 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:06:17 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T07:06:11Z,direct_url=<?>,disk_format='qcow2',id=d3a1e6c9-018f-495e-8204-f598e626c948,min_disk=0,min_ram=0,name='tempest-scenario-img--2019340017',owner='3af4e4870f934158819e183bbc7b499e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T07:06:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-51240574',display_name='tempest-TestMinimumBasicScenario-server-51240574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-51240574',id=48,image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA==',key_name='tempest-TestMinimumBasicScenario-1018447659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-c74f3fun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:06:15Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=aa43db78-a43a-4ef1-b458-12fb253aabd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.objects.instance [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'pci_devices' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:06:17 user nova-compute[74870]:   <uuid>aa43db78-a43a-4ef1-b458-12fb253aabd0</uuid>
Nov 28 07:06:17 user nova-compute[74870]:   <name>instance-00000030</name>
Nov 28 07:06:17 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:06:17 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:06:17 user nova-compute[74870]:   <metadata>
Nov 28 07:06:17 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:06:17 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:06:17 user nova-compute[74870]:       <nova:name>tempest-TestMinimumBasicScenario-server-51240574</nova:name>
Nov 28 07:06:17 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:06:17</nova:creationTime>
Nov 28 07:06:17 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:06:17 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:06:17 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:06:17 user nova-compute[74870]:       <nova:owner>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:user uuid="41da15820f7d43dfad1503c8d7355e6c">tempest-TestMinimumBasicScenario-1726429113-project-member</nova:user>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:project uuid="3af4e4870f934158819e183bbc7b499e">tempest-TestMinimumBasicScenario-1726429113</nova:project>
Nov 28 07:06:17 user nova-compute[74870]:       </nova:owner>
Nov 28 07:06:17 user nova-compute[74870]:       <nova:root type="image" uuid="d3a1e6c9-018f-495e-8204-f598e626c948"/>
Nov 28 07:06:17 user nova-compute[74870]:       <nova:ports>
Nov 28 07:06:17 user nova-compute[74870]:         <nova:port uuid="7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0">
Nov 28 07:06:17 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 07:06:17 user nova-compute[74870]:         </nova:port>
Nov 28 07:06:17 user nova-compute[74870]:       </nova:ports>
Nov 28 07:06:17 user nova-compute[74870]:     </nova:instance>
Nov 28 07:06:17 user nova-compute[74870]:   </metadata>
Nov 28 07:06:17 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:06:17 user nova-compute[74870]:     <system>
Nov 28 07:06:17 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:06:17 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:06:17 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:06:17 user nova-compute[74870]:       <entry name="serial">aa43db78-a43a-4ef1-b458-12fb253aabd0</entry>
Nov 28 07:06:17 user nova-compute[74870]:       <entry name="uuid">aa43db78-a43a-4ef1-b458-12fb253aabd0</entry>
Nov 28 07:06:17 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:06:17 user nova-compute[74870]:     </system>
Nov 28 07:06:17 user nova-compute[74870]:   </sysinfo>
Nov 28 07:06:17 user nova-compute[74870]:   <os>
Nov 28 07:06:17 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:06:17 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:06:17 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:06:17 user nova-compute[74870]:   </os>
Nov 28 07:06:17 user nova-compute[74870]:   <features>
Nov 28 07:06:17 user nova-compute[74870]:     <acpi/>
Nov 28 07:06:17 user nova-compute[74870]:     <apic/>
Nov 28 07:06:17 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:06:17 user nova-compute[74870]:   </features>
Nov 28 07:06:17 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:06:17 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:06:17 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:06:17 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:06:17 user nova-compute[74870]:   </clock>
Nov 28 07:06:17 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:06:17 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:06:17 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:06:17 user nova-compute[74870]:   </cpu>
Nov 28 07:06:17 user nova-compute[74870]:   <devices>
Nov 28 07:06:17 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:06:17 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:06:17 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk"/>
Nov 28 07:06:17 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:06:17 user nova-compute[74870]:     </disk>
Nov 28 07:06:17 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:06:17 user nova-compute[74870]:       <mac address="fa:16:3e:6a:7e:e2"/>
Nov 28 07:06:17 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:06:17 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:06:17 user nova-compute[74870]:       <target dev="tap7ce415bb-a4"/>
Nov 28 07:06:17 user nova-compute[74870]:     </interface>
Nov 28 07:06:17 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:06:17 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/console.log" append="off"/>
Nov 28 07:06:17 user nova-compute[74870]:     </serial>
Nov 28 07:06:17 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:06:17 user nova-compute[74870]:     <video>
Nov 28 07:06:17 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:06:17 user nova-compute[74870]:     </video>
Nov 28 07:06:17 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:06:17 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:06:17 user nova-compute[74870]:     </rng>
Nov 28 07:06:17 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:06:17 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:06:17 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:06:17 user nova-compute[74870]:     </memballoon>
Nov 28 07:06:17 user nova-compute[74870]:   </devices>
Nov 28 07:06:17 user nova-compute[74870]: </domain>
Nov 28 07:06:17 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-51240574',display_name='tempest-TestMinimumBasicScenario-server-51240574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-51240574',id=48,image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA==',key_name='tempest-TestMinimumBasicScenario-1018447659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-c74f3fun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:06:15Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=aa43db78-a43a-4ef1-b458-12fb253aabd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG os_vif [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbd016cd-b1ef-5fed-819e-a9b9bfa02815', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ce415bb-a4, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ce415bb-a4, col_values=(('qos', UUID('97fa24b9-b329-4973-8f32-3104c63c91f6')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ce415bb-a4, col_values=(('external_ids', {'iface-id': '7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:7e:e2', 'vm-uuid': 'aa43db78-a43a-4ef1-b458-12fb253aabd0'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:17 user nova-compute[74870]: INFO os_vif [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4')
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated VIF entry in instance network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:06:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No VIF found with MAC fa:16:3e:6a:7e:e2, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:18 user nova-compute[74870]: WARNING nova.compute.manager [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state building and task_state spawning.
Nov 28 07:06:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:06:20 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance spawned successfully.
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:06:20 user nova-compute[74870]: INFO nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:20 user nova-compute[74870]: WARNING nova.compute.manager [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state building and task_state spawning.
Nov 28 07:06:20 user nova-compute[74870]: INFO nova.compute.manager [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Took 6.39 seconds to build instance.
Nov 28 07:06:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.486s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:29 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:30 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:32 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:06:32 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.254981994628906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance f112048f-4224-409f-bb75-63eb252c6097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:06:32 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:06:33 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:06:33 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:06:33 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:06:33 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: f112048f-4224-409f-bb75-63eb252c6097] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updating instance_info_cache with network_info: [{"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:06:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:06:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:06:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:06:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-changed-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:55 user nova-compute[74870]: DEBUG nova.compute.manager [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Refreshing instance network info cache due to event network-changed-1b92c19d-d039-4173-97fc-8d84aed4a840. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:06:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Acquiring lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:06:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Acquired lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:06:55 user nova-compute[74870]: DEBUG nova.network.neutron [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Refreshing network info cache for port 1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG nova.network.neutron [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updated VIF entry in instance network info cache for port 1b92c19d-d039-4173-97fc-8d84aed4a840. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG nova.network.neutron [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updating instance_info_cache with network_info: [{"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Releasing lock "refresh_cache-f112048f-4224-409f-bb75-63eb252c6097" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "f112048f-4224-409f-bb75-63eb252c6097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:56 user nova-compute[74870]: INFO nova.compute.manager [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Terminating instance
Nov 28 07:06:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-unplugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-unplugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:56 user nova-compute[74870]: DEBUG nova.compute.manager [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-unplugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: f112048f-4224-409f-bb75-63eb252c6097] Instance destroyed successfully.
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'resources' on Instance uuid f112048f-4224-409f-bb75-63eb252c6097 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-897983027',display_name='tempest-TestVolumeBootPattern-server-897983027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-897983027',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-0g5cxsyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:05:17Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=f112048f-4224-409f-bb75-63eb252c6097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "1b92c19d-d039-4173-97fc-8d84aed4a840", "address": "fa:16:3e:94:95:fb", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b92c19d-d0", "ovs_interfaceid": "1b92c19d-d039-4173-97fc-8d84aed4a840", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_vif [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b92c19d-d0, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4ed64e8-f06f-4d84-930d-eb7699e41eae) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:06:57 user nova-compute[74870]: INFO os_vif [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=1b92c19d-d039-4173-97fc-8d84aed4a840,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b92c19d-d0')
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:06:57 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c3cfc-fa34-41ad-b62e-ad3958afe5fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:06:57 user nova-compute[74870]: No targets found.
Nov 28 07:06:57 user nova-compute[74870]: iSNS:
Nov 28 07:06:57 user nova-compute[74870]: No targets found.
Nov 28 07:06:57 user nova-compute[74870]: STATIC:
Nov 28 07:06:57 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:06:57 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:06:57 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:06:57 user nova-compute[74870]: FIRMWARE:
Nov 28 07:06:57 user nova-compute[74870]: No targets found.
Nov 28 07:06:57 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:06:57 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:06:57 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f7f7a9-c79a-4f25-a157-8510a1efb493]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f4842-2272-4c80-8ae9-9d48dd7bc96c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:06:57 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:06:57 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc1249d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f7e1ba-91d7-45d6-b9f5-7783194ffa72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac802e-8ebc-40e3-bc1c-5f4f4916f829]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd5274-f904-4d29-a207-f613f01ebd54]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc1225-62ae-403c-b7e8-f7321900fb9b]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c8eb96a0', '/dev/disk/by-id/scsi-1SCST_BIOc8eb96a0-994ded5b10c03a37', '/dev/disk/by-id/scsi-23939346465643562') {{(pid=85885) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d985717-711d-4e78-a212-33cc8100af8f]: (4, None) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0788e-556c-406f-8eab-6a9cdbbce40b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08634a-c42b-41c3-83c7-acd09eee2051]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]
Nov 28 07:06:57 user nova-compute[74870]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.
Nov 28 07:06:57 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0963837-1d8b-4a41-a63e-c863906e92b4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== disconnect_volume: return (314ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:06:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Deleting instance files /opt/stack/data/nova/instances/f112048f-4224-409f-bb75-63eb252c6097_del
Nov 28 07:06:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Deletion of /opt/stack/data/nova/instances/f112048f-4224-409f-bb75-63eb252c6097_del complete
Nov 28 07:06:57 user nova-compute[74870]: INFO nova.compute.manager [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 07:06:57 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: f112048f-4224-409f-bb75-63eb252c6097] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: f112048f-4224-409f-bb75-63eb252c6097] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:58 user nova-compute[74870]: WARNING nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received unexpected event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with vm_state active and task_state deleting.
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:58 user nova-compute[74870]: WARNING nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received unexpected event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with vm_state active and task_state deleting.
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:58 user nova-compute[74870]: WARNING nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received unexpected event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with vm_state active and task_state deleting.
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-unplugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-unplugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-unplugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Acquiring lock "f112048f-4224-409f-bb75-63eb252c6097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "f112048f-4224-409f-bb75-63eb252c6097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:06:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] No waiting events found dispatching network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:06:58 user nova-compute[74870]: WARNING nova.compute.manager [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received unexpected event network-vif-plugged-1b92c19d-d039-4173-97fc-8d84aed4a840 for instance with vm_state active and task_state deleting.
Nov 28 07:06:59 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: f112048f-4224-409f-bb75-63eb252c6097] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:06:59 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: f112048f-4224-409f-bb75-63eb252c6097] Took 1.38 seconds to deallocate network for instance.
Nov 28 07:06:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:06:59 user nova-compute[74870]: INFO nova.compute.manager [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Took 0.81 seconds to detach 1 volumes for instance.
Nov 28 07:06:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:06:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:00 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:07:00 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:07:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:00 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Deleted allocations for instance f112048f-4224-409f-bb75-63eb252c6097
Nov 28 07:07:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "f112048f-4224-409f-bb75-63eb252c6097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.668s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] [instance: f112048f-4224-409f-bb75-63eb252c6097] Received event network-vif-deleted-1b92c19d-d039-4173-97fc-8d84aed4a840 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:07:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:07:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:07:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:30 user nova-compute[74870]: INFO nova.compute.manager [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Unshelving
Nov 28 07:07:30 user nova-compute[74870]: INFO nova.virt.block_device [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Booting with volume b5ec27cc-cec3-483f-8d88-6568e398a02e at /dev/vda
Nov 28 07:07:30 user nova-compute[74870]: DEBUG os_brick.utils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a40992-41ae-4347-9718-a6d0e5dd3a04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb4a305-4da3-44cb-923f-162272eca9fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca85dbd4-074e-46a6-97f7-d3bd1e0d4689]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[20233fef-c695-4664-b194-70c530ab7c88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:07:30 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:07:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd2abbc-f70e-45b2-ae81-cfbe2ec663a2]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG os_brick.utils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:07:30 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating existing volume attachment record: 17222a10-82b3-4af1-bbf8-7cede6ea96bb {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:07:31 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:34 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:07:34 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:07:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.22610855102539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:07:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:07:35 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:07:35 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:07:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:07:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:07:37 user nova-compute[74870]: INFO nova.compute.claims [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Claim successful on node user
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:07:37 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:07:37 user nova-compute[74870]: INFO nova.network.neutron [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating port 3edba92c-a2b6-485d-985d-00a244d7207f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing instance network info cache due to event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:07:38 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Creating image(s)
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Ensure instance console log exists: /opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Start _get_guest_xml network_info=[{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a69c84f-a030-4262-8f84-7d4bd72db3fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5ec27cc-cec3-483f-8d88-6568e398a02e', 'serial': 'b5ec27cc-cec3-483f-8d88-6568e398a02e'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '17222a10-82b3-4af1-bbf8-7cede6ea96bb', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:07:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:07:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.objects.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Object Instance<6a69c84f-a030-4262-8f84-7d4bd72db3fe> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:07:38 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:07:38 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:07:38 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[35078961-fd87-441f-b3e6-3d86e91b8e34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:07:38 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91794eb-3700-432a-aef0-9a825f8a56c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e] added
Nov 28 07:07:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[988c9699-291d-4809-ba29-a14f224c6afd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa06b4-92a3-442c-9c39-4d24f65762fb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXlCrNzc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXlCrNzc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823191b-6714-4726-9b71-9145f1104ec0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXlCrNzc'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a2449-b956-424e-8024-fa85c25ab935]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c38031-2875-4cc6-9f5b-3fc9a191f441]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:07:38 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:07:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:07:38 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:07:38 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 07:07:38 user nova-compute[74870]: 
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741f5c2-600a-4282-a3e6-163274c670c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]
Nov 28 07:07:39 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.
Nov 28 07:07:39 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[41beefd6-73df-4916-a328-3a6665d8793d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83e0e7-0c14-4789-b770-da84333505eb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:07:39 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:07:39 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee24012c-69c6-45fd-b5b3-569b63e55618]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated VIF entry in instance network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:07:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23762353130346235', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762353130346235', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T07:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945636414',display_name='tempest-TestShelveInstance-server-945636414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945636414',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1887206196',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:03:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f9fb47f7da246f9b569ca12206c5726',ramdisk_id='',reservation_id='r-wm7z698x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1756841419',owner_user_name='tempest-TestShelveInstance-1756841419-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:07:31Z,user_data=None,user_id='a54dae1189f7405eb8b8b1aefe0b6ce7',uuid=6a69c84f-a030-4262-8f84-7d4bd72db3fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converting VIF {"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.objects.base [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Object Instance<6a69c84f-a030-4262-8f84-7d4bd72db3fe> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:07:40 user nova-compute[74870]:   <uuid>6a69c84f-a030-4262-8f84-7d4bd72db3fe</uuid>
Nov 28 07:07:40 user nova-compute[74870]:   <name>instance-0000002e</name>
Nov 28 07:07:40 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:07:40 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:07:40 user nova-compute[74870]:   <metadata>
Nov 28 07:07:40 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:07:40 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:07:40 user nova-compute[74870]:       <nova:name>tempest-TestShelveInstance-server-945636414</nova:name>
Nov 28 07:07:40 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:07:38</nova:creationTime>
Nov 28 07:07:40 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:07:40 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:07:40 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:07:40 user nova-compute[74870]:       <nova:owner>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:user uuid="a54dae1189f7405eb8b8b1aefe0b6ce7">tempest-TestShelveInstance-1756841419-project-member</nova:user>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:project uuid="8f9fb47f7da246f9b569ca12206c5726">tempest-TestShelveInstance-1756841419</nova:project>
Nov 28 07:07:40 user nova-compute[74870]:       </nova:owner>
Nov 28 07:07:40 user nova-compute[74870]:       <nova:ports>
Nov 28 07:07:40 user nova-compute[74870]:         <nova:port uuid="3edba92c-a2b6-485d-985d-00a244d7207f">
Nov 28 07:07:40 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 07:07:40 user nova-compute[74870]:         </nova:port>
Nov 28 07:07:40 user nova-compute[74870]:       </nova:ports>
Nov 28 07:07:40 user nova-compute[74870]:     </nova:instance>
Nov 28 07:07:40 user nova-compute[74870]:   </metadata>
Nov 28 07:07:40 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:07:40 user nova-compute[74870]:     <system>
Nov 28 07:07:40 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:07:40 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:07:40 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:07:40 user nova-compute[74870]:       <entry name="serial">6a69c84f-a030-4262-8f84-7d4bd72db3fe</entry>
Nov 28 07:07:40 user nova-compute[74870]:       <entry name="uuid">6a69c84f-a030-4262-8f84-7d4bd72db3fe</entry>
Nov 28 07:07:40 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:07:40 user nova-compute[74870]:     </system>
Nov 28 07:07:40 user nova-compute[74870]:   </sysinfo>
Nov 28 07:07:40 user nova-compute[74870]:   <os>
Nov 28 07:07:40 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:07:40 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:07:40 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:07:40 user nova-compute[74870]:   </os>
Nov 28 07:07:40 user nova-compute[74870]:   <features>
Nov 28 07:07:40 user nova-compute[74870]:     <acpi/>
Nov 28 07:07:40 user nova-compute[74870]:     <apic/>
Nov 28 07:07:40 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:07:40 user nova-compute[74870]:   </features>
Nov 28 07:07:40 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:07:40 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:07:40 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:07:40 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:07:40 user nova-compute[74870]:   </clock>
Nov 28 07:07:40 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:07:40 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:07:40 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:07:40 user nova-compute[74870]:   </cpu>
Nov 28 07:07:40 user nova-compute[74870]:   <devices>
Nov 28 07:07:40 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:07:40 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:07:40 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 07:07:40 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:07:40 user nova-compute[74870]:       <serial>b5ec27cc-cec3-483f-8d88-6568e398a02e</serial>
Nov 28 07:07:40 user nova-compute[74870]:     </disk>
Nov 28 07:07:40 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:07:40 user nova-compute[74870]:       <mac address="fa:16:3e:62:86:57"/>
Nov 28 07:07:40 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:07:40 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:07:40 user nova-compute[74870]:       <target dev="tap3edba92c-a2"/>
Nov 28 07:07:40 user nova-compute[74870]:     </interface>
Nov 28 07:07:40 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:07:40 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe/console.log" append="off"/>
Nov 28 07:07:40 user nova-compute[74870]:     </serial>
Nov 28 07:07:40 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:07:40 user nova-compute[74870]:     <video>
Nov 28 07:07:40 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:07:40 user nova-compute[74870]:     </video>
Nov 28 07:07:40 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:07:40 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:07:40 user nova-compute[74870]:     </rng>
Nov 28 07:07:40 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:07:40 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:07:40 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:07:40 user nova-compute[74870]:     </memballoon>
Nov 28 07:07:40 user nova-compute[74870]:   </devices>
Nov 28 07:07:40 user nova-compute[74870]: </domain>
Nov 28 07:07:40 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T07:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945636414',display_name='tempest-TestShelveInstance-server-945636414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945636414',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1887206196',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:03:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f9fb47f7da246f9b569ca12206c5726',ramdisk_id='',reservation_id='r-wm7z698x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1756841419',owner_user_name='tempest-TestShelveInstance-1756841419-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:07:31Z,user_data=None,user_id='a54dae1189f7405eb8b8b1aefe0b6ce7',uuid=6a69c84f-a030-4262-8f84-7d4bd72db3fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converting VIF {"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG os_vif [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4da8f552-cf36-5ac8-9216-908e6d8a7dfc', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3edba92c-a2, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3edba92c-a2, col_values=(('qos', UUID('222b18ac-83bb-4d51-b631-37cddc3309e6')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3edba92c-a2, col_values=(('external_ids', {'iface-id': '3edba92c-a2b6-485d-985d-00a244d7207f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:86:57', 'vm-uuid': '6a69c84f-a030-4262-8f84-7d4bd72db3fe'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:40 user nova-compute[74870]: INFO os_vif [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2')
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:07:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] No VIF found with MAC fa:16:3e:62:86:57, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:07:41 user nova-compute[74870]: WARNING nova.compute.manager [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 07:07:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:07:43 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance spawned successfully.
Nov 28 07:07:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.094s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:07:43 user nova-compute[74870]: WARNING nova.compute.manager [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state active and task_state None.
Nov 28 07:07:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:07:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:07:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:07:48 user nova-compute[74870]: INFO nova.compute.claims [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Claim successful on node user
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:07:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:07:48 user nova-compute[74870]: INFO nova.virt.block_device [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Booting with volume fba423b6-1127-46d5-a9a7-87dd41849861 at /dev/vda
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.policy [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG os_brick.utils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30d876-f362-4456-a834-854c30bdbeeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e9f614-68d2-46ef-9b1b-f56222d8aeb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10614c62-6f13-403f-880a-f942d3cb8ecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e00acea-c7b9-46bd-a4e1-5192127b410c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:07:48 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:07:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[608067da-a614-42e3-b6b8-a102b866c769]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG os_brick.utils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:07:48 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating existing volume attachment record: 0edd57fc-6f43-471f-8af7-44ebdc4a1f24 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Successfully created port: d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Successfully updated port: d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquired lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-changed-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Refreshing instance network info cache due to event network-changed-d7a4564b-b7fb-4f25-8afd-a74624159c8b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Acquiring lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:07:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Releasing lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Instance network_info: |[{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Acquired lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Refreshing network info cache for port d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updated VIF entry in instance network info cache for port d7a4564b-b7fb-4f25-8afd-a74624159c8b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG nova.network.neutron [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:07:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Releasing lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:07:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Creating image(s)
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Ensure instance console log exists: /opt/stack/data/nova/instances/5c4f1347-91b0-40ac-9190-889e27afba0b/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Start _get_guest_xml network_info=[{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c4f1347-91b0-40ac-9190-889e27afba0b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fba423b6-1127-46d5-a9a7-87dd41849861', 'serial': 'fba423b6-1127-46d5-a9a7-87dd41849861'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0edd57fc-6f43-471f-8af7-44ebdc4a1f24', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:07:55 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:07:55 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:07:55 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:07:55 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:07:55 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0637bbe7-95fe-44e5-b8c2-ed106ea77b5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:07:55 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06bffb-d3ba-45fd-b9eb-51026bd38af8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861] added
Nov 28 07:07:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3533ea25-e52a-4093-a6e3-492db94da119]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[86030357-0280-4c26-8858-4f585703110a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJPmqnuW {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJPmqnuW" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6b0333-bf68-4ab8-bf0d-55b434295281]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJPmqnuW'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427163a-efc5-491c-a451-9a9a9a29c269]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17356329-076b-483c-8b24-dff33b292c99]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:07:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:07:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e506b-c9d1-45d9-b3d1-1f7646668cfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]
Nov 28 07:07:55 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.
Nov 28 07:07:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db96653-bb05-41b7-87cd-4805b3cfeba5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16100aa5-dc0f-47fc-a0cb-faa18bc5d91a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:07:55 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:07:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:07:55 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:07:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eb8675-dbb5-44e6-a126-a0a8e6976776]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:07:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23939346465643562', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939346465643562', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618794767',display_name='tempest-TestVolumeBootPattern-server-1618794767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618794767',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-6bdm78nu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:07:49Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=5c4f1347-91b0-40ac-9190-889e27afba0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c4f1347-91b0-40ac-9190-889e27afba0b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:07:56 user nova-compute[74870]:   <uuid>5c4f1347-91b0-40ac-9190-889e27afba0b</uuid>
Nov 28 07:07:56 user nova-compute[74870]:   <name>instance-00000031</name>
Nov 28 07:07:56 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:07:56 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:07:56 user nova-compute[74870]:   <metadata>
Nov 28 07:07:56 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:07:56 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:07:56 user nova-compute[74870]:       <nova:name>tempest-TestVolumeBootPattern-server-1618794767</nova:name>
Nov 28 07:07:56 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:07:55</nova:creationTime>
Nov 28 07:07:56 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:07:56 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:07:56 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:07:56 user nova-compute[74870]:       <nova:owner>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:user uuid="2139976b453e4bd2b8e83e551a0cc772">tempest-TestVolumeBootPattern-1541228194-project-member</nova:user>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:project uuid="cecfa8e54acf42a8affd8686f500d6c9">tempest-TestVolumeBootPattern-1541228194</nova:project>
Nov 28 07:07:56 user nova-compute[74870]:       </nova:owner>
Nov 28 07:07:56 user nova-compute[74870]:       <nova:ports>
Nov 28 07:07:56 user nova-compute[74870]:         <nova:port uuid="d7a4564b-b7fb-4f25-8afd-a74624159c8b">
Nov 28 07:07:56 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 07:07:56 user nova-compute[74870]:         </nova:port>
Nov 28 07:07:56 user nova-compute[74870]:       </nova:ports>
Nov 28 07:07:56 user nova-compute[74870]:     </nova:instance>
Nov 28 07:07:56 user nova-compute[74870]:   </metadata>
Nov 28 07:07:56 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:07:56 user nova-compute[74870]:     <system>
Nov 28 07:07:56 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:07:56 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:07:56 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:07:56 user nova-compute[74870]:       <entry name="serial">5c4f1347-91b0-40ac-9190-889e27afba0b</entry>
Nov 28 07:07:56 user nova-compute[74870]:       <entry name="uuid">5c4f1347-91b0-40ac-9190-889e27afba0b</entry>
Nov 28 07:07:56 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:07:56 user nova-compute[74870]:     </system>
Nov 28 07:07:56 user nova-compute[74870]:   </sysinfo>
Nov 28 07:07:56 user nova-compute[74870]:   <os>
Nov 28 07:07:56 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:07:56 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:07:56 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:07:56 user nova-compute[74870]:   </os>
Nov 28 07:07:56 user nova-compute[74870]:   <features>
Nov 28 07:07:56 user nova-compute[74870]:     <acpi/>
Nov 28 07:07:56 user nova-compute[74870]:     <apic/>
Nov 28 07:07:56 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:07:56 user nova-compute[74870]:   </features>
Nov 28 07:07:56 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:07:56 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:07:56 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:07:56 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:07:56 user nova-compute[74870]:   </clock>
Nov 28 07:07:56 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:07:56 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:07:56 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:07:56 user nova-compute[74870]:   </cpu>
Nov 28 07:07:56 user nova-compute[74870]:   <devices>
Nov 28 07:07:56 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:07:56 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:07:56 user nova-compute[74870]:       <source dev="/dev/sdc"/>
Nov 28 07:07:56 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:07:56 user nova-compute[74870]:       <serial>fba423b6-1127-46d5-a9a7-87dd41849861</serial>
Nov 28 07:07:56 user nova-compute[74870]:     </disk>
Nov 28 07:07:56 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:07:56 user nova-compute[74870]:       <mac address="fa:16:3e:11:2a:b6"/>
Nov 28 07:07:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:07:56 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:07:56 user nova-compute[74870]:       <target dev="tapd7a4564b-b7"/>
Nov 28 07:07:56 user nova-compute[74870]:     </interface>
Nov 28 07:07:56 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:07:56 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/5c4f1347-91b0-40ac-9190-889e27afba0b/console.log" append="off"/>
Nov 28 07:07:56 user nova-compute[74870]:     </serial>
Nov 28 07:07:56 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:07:56 user nova-compute[74870]:     <video>
Nov 28 07:07:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:07:56 user nova-compute[74870]:     </video>
Nov 28 07:07:56 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:07:56 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:07:56 user nova-compute[74870]:     </rng>
Nov 28 07:07:56 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:07:56 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:07:56 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:07:56 user nova-compute[74870]:     </memballoon>
Nov 28 07:07:56 user nova-compute[74870]:   </devices>
Nov 28 07:07:56 user nova-compute[74870]: </domain>
Nov 28 07:07:56 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618794767',display_name='tempest-TestVolumeBootPattern-server-1618794767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618794767',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-6bdm78nu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:07:49Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=5c4f1347-91b0-40ac-9190-889e27afba0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG os_vif [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef9d3e20-c1a7-51c8-8c5f-1c5f75c00662', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7a4564b-b7, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7a4564b-b7, col_values=(('qos', UUID('6ee53967-66b1-49dc-be49-138f07276749')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7a4564b-b7, col_values=(('external_ids', {'iface-id': 'd7a4564b-b7fb-4f25-8afd-a74624159c8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:2a:b6', 'vm-uuid': '5c4f1347-91b0-40ac-9190-889e27afba0b'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:56 user nova-compute[74870]: INFO os_vif [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7')
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:07:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No VIF found with MAC fa:16:3e:11:2a:b6, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] No waiting events found dispatching network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:07:58 user nova-compute[74870]: WARNING nova.compute.manager [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received unexpected event network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance with vm_state building and task_state spawning.
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:07:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:08:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Instance spawned successfully.
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:08:00 user nova-compute[74870]: INFO nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] No waiting events found dispatching network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:08:00 user nova-compute[74870]: WARNING nova.compute.manager [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received unexpected event network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance with vm_state building and task_state spawning.
Nov 28 07:08:00 user nova-compute[74870]: INFO nova.compute.manager [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Took 12.29 seconds to build instance.
Nov 28 07:08:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.383s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'flavor' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:08 user nova-compute[74870]: INFO nova.compute.manager [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Attaching volume d6996258-ad77-4f65-b6c2-ea5ab46cae9d to /dev/vdb
Nov 28 07:08:08 user nova-compute[74870]: DEBUG os_brick.utils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4dbfee-672c-4589-a7fc-3315dea1a2bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3bec0a-2559-4b23-b403-8ad5bc1eb9c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f1380-ac2e-48e0-a601-7d1bf6f8912c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846d024-a520-40e3-a8ae-c9c6173c1eae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:08:08 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:08:08 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffded38-e5c1-4f3b-abf6-3e9206ccb8da]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG os_brick.utils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:08:08 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating existing volume attachment record: adc4ecd5-47f1-40ec-addd-e31355b728c4 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:08:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:08:15 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:08:15 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:08:15 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5a8e0-2a32-402b-b21f-81db89dbf62c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:08:15 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4ec53-c6e5-4844-ab41-d09998da47ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d] added
Nov 28 07:08:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcf3b6-bfff-40f5-a695-1f9a6337ce30]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e659a4c-8a4b-42b6-82b9-f7518bc3f37c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKgvJHMq {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKgvJHMq" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4975f0e9-92ea-4b07-83c5-a2d15263054e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKgvJHMq'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dab59c4-f20f-45e0-be9b-2e1df0905df5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed2ac96-b1fa-4f86-9fb0-6a611bdce10e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:15 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:15 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cba123-a152-4d5c-bade-672045afcf03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]
Nov 28 07:08:15 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.
Nov 28 07:08:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863a4aa-6837-4aa1-9889-5a8fec05b05e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bfcaa9-93b0-4c59-9fd0-0dc04dea1f18]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:15 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:15 user nova-compute[74870]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:08:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:15 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:15 user nova-compute[74870]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:08:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf652402-4d4d-47f0-b2ab-9c014f49af80]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26239376334643062', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239376334643062', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'flavor' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:08:16 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:08:16 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 07:08:16 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:08:16 user nova-compute[74870]:   <serial>d6996258-ad77-4f65-b6c2-ea5ab46cae9d</serial>
Nov 28 07:08:16 user nova-compute[74870]: </disk>
Nov 28 07:08:16 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No VIF found with MAC fa:16:3e:6a:7e:e2, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:08:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.800s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing instance network info cache due to event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:08:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:08:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:08:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:08:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated VIF entry in instance network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:08:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:08:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:08:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG nova.compute.manager [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing instance network info cache due to event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated VIF entry in instance network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG nova.network.neutron [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:08:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:08:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:28 user nova-compute[74870]: INFO nova.compute.manager [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Rebooting instance
Nov 28 07:08:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:08:29 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:08:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:08:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:29 user nova-compute[74870]: DEBUG nova.network.neutron [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.compute.manager [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.compute.manager [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:08:30 user nova-compute[74870]: WARNING nova.compute.manager [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 07:08:30 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance destroyed successfully.
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.objects.instance [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'resources' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-51240574',display_name='tempest-TestMinimumBasicScenario-server-51240574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-51240574',id=48,image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA==',key_name='tempest-TestMinimumBasicScenario-1018447659',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-c74f3fun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:08:30Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=aa43db78-a43a-4ef1-b458-12fb253aabd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ce415bb-a4, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97fa24b9-b329-4973-8f32-3104c63c91f6) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:30 user nova-compute[74870]: INFO os_vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4')
Nov 28 07:08:30 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:08:30 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[04470019-2c7e-4d12-a07f-9ec38f8baf7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:08:30 user nova-compute[74870]: No targets found.
Nov 28 07:08:30 user nova-compute[74870]: iSNS:
Nov 28 07:08:30 user nova-compute[74870]: No targets found.
Nov 28 07:08:30 user nova-compute[74870]: STATIC:
Nov 28 07:08:30 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e
Nov 28 07:08:30 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:08:30 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:08:30 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d
Nov 28 07:08:30 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:08:30 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:08:30 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:08:30 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:08:30 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:08:30 user nova-compute[74870]: FIRMWARE:
Nov 28 07:08:30 user nova-compute[74870]: No targets found.
Nov 28 07:08:30 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:08:30 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:08:30 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf25062-0c47-462a-a39d-71221c114e27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:30 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e3f34c-090b-4a12-93d2-ec4923583196]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc1a29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d'): ({'sdd'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Removing single pathed devices sdd {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943e711-25e8-4ac0-846e-8305610e2ecd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7b52f2-ca7d-4b4d-833e-f33078102e51]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flushing IO for device /dev/sdd {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c1e5f-fe02-4419-9bb8-2d9fa20694cf]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[09547e3d-e25a-4a7b-9be9-4a48b825822a]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76eca0-1338-4ef8-ba51-829d997b5897]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4e5c83-8ec0-46cb-8176-44d88800fd0e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]
Nov 28 07:08:31 user nova-compute[74870]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d1480e-e4fc-4884-9430-4388a8b25187]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== disconnect_volume: return (292ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Start _get_guest_xml network_info=[{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d3a1e6c9-018f-495e-8204-f598e626c948,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'd3a1e6c9-018f-495e-8204-f598e626c948'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'aa43db78-a43a-4ef1-b458-12fb253aabd0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'serial': 'd6996258-ad77-4f65-b6c2-ea5ab46cae9d'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'adc4ecd5-47f1-40ec-addd-e31355b728c4', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:08:31 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:08:31 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d3a1e6c9-018f-495e-8204-f598e626c948,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.objects.instance [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.objects.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Object Instance<aa43db78-a43a-4ef1-b458-12fb253aabd0> lazy-loaded attributes: resources,vcpu_model {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:08:31 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:08:31 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:08:31 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8718fe-af25-4ce2-b058-4575a287bd98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:08:31 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846fd28-3b48-4d3e-b579-1768e253f8b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d] added
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8cf817-af43-4df2-8790-79cbb5d435e1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d95234-a75c-40db-8331-81081455b6be]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKgvJHMq {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKgvJHMq" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47cb732-21da-4eca-a790-cd108c1e3621]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKgvJHMq'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9935c-d9ab-4614-8647-66a3fd5f7c23]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3888b00e-f37d-4038-8f38-3a67f49e84f7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59e2917-e1e3-40a7-966a-e9e366fee981]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]
Nov 28 07:08:31 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a9586-9fb2-48e7-8fed-3d35945aea4d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5996a1b-54ae-4914-b8d1-f21f2b185c49]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:08:31 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:08:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e58ada4-b4d8-440d-9d0f-6e68a4e09c0d]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:08:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26239376334643062', 'path': '/dev/sdd'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239376334643062', 'path': '/dev/sdd'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.compute.manager [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:08:32 user nova-compute[74870]: WARNING nova.compute.manager [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-51240574',display_name='tempest-TestMinimumBasicScenario-server-51240574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-51240574',id=48,image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA==',key_name='tempest-TestMinimumBasicScenario-1018447659',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-c74f3fun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:08:30Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=aa43db78-a43a-4ef1-b458-12fb253aabd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.objects.instance [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'pci_devices' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.objects.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Object Instance<aa43db78-a43a-4ef1-b458-12fb253aabd0> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:08:32 user nova-compute[74870]:   <uuid>aa43db78-a43a-4ef1-b458-12fb253aabd0</uuid>
Nov 28 07:08:32 user nova-compute[74870]:   <name>instance-00000030</name>
Nov 28 07:08:32 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:08:32 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:08:32 user nova-compute[74870]:   <metadata>
Nov 28 07:08:32 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:08:32 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:08:32 user nova-compute[74870]:       <nova:name>tempest-TestMinimumBasicScenario-server-51240574</nova:name>
Nov 28 07:08:32 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:08:31</nova:creationTime>
Nov 28 07:08:32 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:08:32 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:08:32 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:08:32 user nova-compute[74870]:       <nova:owner>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:user uuid="41da15820f7d43dfad1503c8d7355e6c">tempest-TestMinimumBasicScenario-1726429113-project-member</nova:user>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:project uuid="3af4e4870f934158819e183bbc7b499e">tempest-TestMinimumBasicScenario-1726429113</nova:project>
Nov 28 07:08:32 user nova-compute[74870]:       </nova:owner>
Nov 28 07:08:32 user nova-compute[74870]:       <nova:root type="image" uuid="d3a1e6c9-018f-495e-8204-f598e626c948"/>
Nov 28 07:08:32 user nova-compute[74870]:       <nova:ports>
Nov 28 07:08:32 user nova-compute[74870]:         <nova:port uuid="7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0">
Nov 28 07:08:32 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 07:08:32 user nova-compute[74870]:         </nova:port>
Nov 28 07:08:32 user nova-compute[74870]:       </nova:ports>
Nov 28 07:08:32 user nova-compute[74870]:     </nova:instance>
Nov 28 07:08:32 user nova-compute[74870]:   </metadata>
Nov 28 07:08:32 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:08:32 user nova-compute[74870]:     <system>
Nov 28 07:08:32 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:08:32 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:08:32 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:08:32 user nova-compute[74870]:       <entry name="serial">aa43db78-a43a-4ef1-b458-12fb253aabd0</entry>
Nov 28 07:08:32 user nova-compute[74870]:       <entry name="uuid">aa43db78-a43a-4ef1-b458-12fb253aabd0</entry>
Nov 28 07:08:32 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:08:32 user nova-compute[74870]:     </system>
Nov 28 07:08:32 user nova-compute[74870]:   </sysinfo>
Nov 28 07:08:32 user nova-compute[74870]:   <os>
Nov 28 07:08:32 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:08:32 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:08:32 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:08:32 user nova-compute[74870]:   </os>
Nov 28 07:08:32 user nova-compute[74870]:   <features>
Nov 28 07:08:32 user nova-compute[74870]:     <acpi/>
Nov 28 07:08:32 user nova-compute[74870]:     <apic/>
Nov 28 07:08:32 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:08:32 user nova-compute[74870]:   </features>
Nov 28 07:08:32 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:08:32 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:08:32 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:08:32 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:08:32 user nova-compute[74870]:   </clock>
Nov 28 07:08:32 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:08:32 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:08:32 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:08:32 user nova-compute[74870]:   </cpu>
Nov 28 07:08:32 user nova-compute[74870]:   <devices>
Nov 28 07:08:32 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:08:32 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:08:32 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk"/>
Nov 28 07:08:32 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:08:32 user nova-compute[74870]:     </disk>
Nov 28 07:08:32 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:08:32 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:08:32 user nova-compute[74870]:       <source dev="/dev/sdd"/>
Nov 28 07:08:32 user nova-compute[74870]:       <target dev="vdb" bus="virtio"/>
Nov 28 07:08:32 user nova-compute[74870]:       <serial>d6996258-ad77-4f65-b6c2-ea5ab46cae9d</serial>
Nov 28 07:08:32 user nova-compute[74870]:     </disk>
Nov 28 07:08:32 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:08:32 user nova-compute[74870]:       <mac address="fa:16:3e:6a:7e:e2"/>
Nov 28 07:08:32 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:08:32 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:08:32 user nova-compute[74870]:       <target dev="tap7ce415bb-a4"/>
Nov 28 07:08:32 user nova-compute[74870]:     </interface>
Nov 28 07:08:32 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:08:32 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/console.log" append="off"/>
Nov 28 07:08:32 user nova-compute[74870]:     </serial>
Nov 28 07:08:32 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:08:32 user nova-compute[74870]:     <video>
Nov 28 07:08:32 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:08:32 user nova-compute[74870]:     </video>
Nov 28 07:08:32 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:08:32 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:08:32 user nova-compute[74870]:     </rng>
Nov 28 07:08:32 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:08:32 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:08:32 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:08:32 user nova-compute[74870]:     </memballoon>
Nov 28 07:08:32 user nova-compute[74870]:   </devices>
Nov 28 07:08:32 user nova-compute[74870]: </domain>
Nov 28 07:08:32 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.objects.instance [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG nova.objects.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Object Instance<aa43db78-a43a-4ef1-b458-12fb253aabd0> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:08:32 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Cannot resize image /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.objects.instance [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'migration_context' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.objects.base [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Object Instance<aa43db78-a43a-4ef1-b458-12fb253aabd0> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-51240574',display_name='tempest-TestMinimumBasicScenario-server-51240574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-51240574',id=48,image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA==',key_name='tempest-TestMinimumBasicScenario-1018447659',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-c74f3fun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:08:30Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=aa43db78-a43a-4ef1-b458-12fb253aabd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG os_vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbd016cd-b1ef-5fed-819e-a9b9bfa02815', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ce415bb-a4, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ce415bb-a4, col_values=(('qos', UUID('ac43ef32-ade9-4f99-a0cf-7974acf47413')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ce415bb-a4, col_values=(('external_ids', {'iface-id': '7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:7e:e2', 'vm-uuid': 'aa43db78-a43a-4ef1-b458-12fb253aabd0'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:08:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:33 user nova-compute[74870]: INFO os_vif [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4')
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:34 user nova-compute[74870]: DEBUG nova.compute.manager [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:08:34 user nova-compute[74870]: WARNING nova.compute.manager [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 07:08:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:08:35 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:08:35 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:08:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=25.21462631225586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5c4f1347-91b0-40ac-9190-889e27afba0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:08:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance rebooted successfully.
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:36 user nova-compute[74870]: DEBUG nova.compute.manager [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:08:36 user nova-compute[74870]: WARNING nova.compute.manager [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 07:08:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.933s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:08:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:08:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:08:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:08:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:52 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:08:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:08:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing instance network info cache due to event network-changed-3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Acquiring lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Acquired lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Refreshing network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:21 user nova-compute[74870]: INFO nova.compute.manager [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Terminating instance
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-unplugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-unplugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-unplugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:09:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updated VIF entry in instance network info cache for port 3edba92c-a2b6-485d-985d-00a244d7207f. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [{"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Releasing lock "refresh_cache-6a69c84f-a030-4262-8f84-7d4bd72db3fe" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Instance destroyed successfully.
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'resources' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T07:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945636414',display_name='tempest-TestShelveInstance-server-945636414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945636414',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/8TK0s6S6jr6eVoVISilIkFNISMDUr3k40yMWuPUApm+U40gTGbmzKNum2DQ1fk//z2lD/tCVOMz+xgbRbztjSm+nTNW4EUfhK5oA+KcwC8c2v28/4DXqA2z9nZAmGbw==',key_name='tempest-TestShelveInstance-1887206196',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:07:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f9fb47f7da246f9b569ca12206c5726',ramdisk_id='',reservation_id='r-wm7z698x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1756841419',owner_user_name='tempest-TestShelveInstance-1756841419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:07:44Z,user_data=None,user_id='a54dae1189f7405eb8b8b1aefe0b6ce7',uuid=6a69c84f-a030-4262-8f84-7d4bd72db3fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converting VIF {"id": "3edba92c-a2b6-485d-985d-00a244d7207f", "address": "fa:16:3e:62:86:57", "network": {"id": "fa2c7e3c-130c-4424-a022-179dd0bd6f04", "bridge": "br-int", "label": "tempest-TestShelveInstance-1786524763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9fb47f7da246f9b569ca12206c5726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edba92c-a2", "ovs_interfaceid": "3edba92c-a2b6-485d-985d-00a244d7207f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_vif [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3edba92c-a2, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=222b18ac-83bb-4d51-b631-37cddc3309e6) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:22 user nova-compute[74870]: INFO os_vif [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:86:57,bridge_name='br-int',has_traffic_filtering=True,id=3edba92c-a2b6-485d-985d-00a244d7207f,network=Network(fa2c7e3c-130c-4424-a022-179dd0bd6f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edba92c-a2')
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXlCrNzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:09:22 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b569fe79-8f9c-4d8d-87b3-b2d6eafb7651]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:09:22 user nova-compute[74870]: No targets found.
Nov 28 07:09:22 user nova-compute[74870]: iSNS:
Nov 28 07:09:22 user nova-compute[74870]: No targets found.
Nov 28 07:09:22 user nova-compute[74870]: STATIC:
Nov 28 07:09:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e
Nov 28 07:09:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:09:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:09:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d
Nov 28 07:09:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:09:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:09:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:09:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:09:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:09:22 user nova-compute[74870]: FIRMWARE:
Nov 28 07:09:22 user nova-compute[74870]: No targets found.
Nov 28 07:09:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:09:22 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:09:22 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8609e-2bd8-4bed-a194-12d82a9b3e2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f64542-f549-4441-b458-e020d829a490]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:09:22 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:09:22 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:09:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e (non-flash)
Nov 28 07:09:22 user nova-compute[74870]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:09:22 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:09:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc617250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f349b791-40e4-44f3-854f-4abb40a9ebdf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a47b9-568d-433a-a994-5d43be798313]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f842ba-ec4a-4607-bffd-22b59a5ea3e1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80626c13-8a90-4c11-aa4f-d0bc9def54b5]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1440cc9-6e25-42a1-8482-f867c7f074d9]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ed47be-ae62-4c65-936f-2eff1cae6f4b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260]
Nov 28 07:09:22 user nova-compute[74870]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e, portal: 172.16.0.220,3260] successful.
Nov 28 07:09:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ec27cc-cec3-483f-8d88-6568e398a02e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9beef0-4f73-461a-b37c-72fc3f8e7881]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] <== disconnect_volume: return (316ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:09:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Deleting instance files /opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe_del
Nov 28 07:09:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Deletion of /opt/stack/data/nova/instances/6a69c84f-a030-4262-8f84-7d4bd72db3fe_del complete
Nov 28 07:09:22 user nova-compute[74870]: INFO nova.compute.manager [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 07:09:22 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:09:22 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:23 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Took 0.40 seconds to deallocate network for instance.
Nov 28 07:09:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-deleted-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:23 user nova-compute[74870]: INFO nova.compute.manager [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Neutron deleted interface 3edba92c-a2b6-485d-985d-00a244d7207f; detaching it from the instance and deleting it from the info cache
Nov 28 07:09:23 user nova-compute[74870]: DEBUG nova.network.neutron [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Detach interface failed, port_id=3edba92c-a2b6-485d-985d-00a244d7207f, reason: Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe could not be found. {{(pid=74870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 07:09:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Acquiring lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:23 user nova-compute[74870]: DEBUG nova.compute.manager [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] No waiting events found dispatching network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:09:23 user nova-compute[74870]: WARNING nova.compute.manager [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Received unexpected event network-vif-plugged-3edba92c-a2b6-485d-985d-00a244d7207f for instance with vm_state active and task_state deleting.
Nov 28 07:09:23 user nova-compute[74870]: INFO nova.compute.manager [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Took 0.95 seconds to detach 1 volumes for instance.
Nov 28 07:09:23 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Deleting volume: b5ec27cc-cec3-483f-8d88-6568e398a02e {{(pid=74870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 07:09:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:24 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:09:24 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:09:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:24 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Deleted allocations for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe
Nov 28 07:09:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "6a69c84f-a030-4262-8f84-7d4bd72db3fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.913s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:33 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:09:34 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:09:34 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:09:34 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.213024139404297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:34 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5c4f1347-91b0-40ac-9190-889e27afba0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:09:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:09:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-changed-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Refreshing instance network info cache due to event network-changed-d7a4564b-b7fb-4f25-8afd-a74624159c8b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Acquiring lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Acquired lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Refreshing network info cache for port d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updated VIF entry in instance network info cache for port d7a4564b-b7fb-4f25-8afd-a74624159c8b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG nova.network.neutron [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Releasing lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:09:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:09:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 07:09:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:09:47 user nova-compute[74870]: INFO nova.compute.claims [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Claim successful on node user
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:09:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:09:48 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:09:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG nova.policy [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:09:48 user nova-compute[74870]: INFO nova.virt.block_device [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Booting with volume 8910b4cd-fecb-411d-89e6-d63b7023bd44 at /dev/vda
Nov 28 07:09:48 user nova-compute[74870]: DEBUG os_brick.utils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94aeed8-dff9-4d93-b64c-0dc11e07e421]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c42461-4240-490b-8a5f-ea9add591af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261dbd0-8585-46a1-ad02-96d6f926a9bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394ac90-5bbe-4c2a-887b-ea7402afb979]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:09:48 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:09:48 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b709779c-a631-4dda-be2b-3573204d68a1]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG os_brick.utils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updating existing volume attachment record: 86a7ec77-f736-4605-a84a-3dafd2f762e4 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:09:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Successfully created port: 663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Successfully updated port: 663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquired lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-changed-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.compute.manager [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Refreshing instance network info cache due to event network-changed-663ecf4e-8168-49a1-80d0-f13f491f4b06. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Acquiring lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updating instance_info_cache with network_info: [{"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Releasing lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Instance network_info: |[{"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Acquired lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Refreshing network info cache for port 663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updated VIF entry in instance network info cache for port 663ecf4e-8168-49a1-80d0-f13f491f4b06. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG nova.network.neutron [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updating instance_info_cache with network_info: [{"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:09:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Releasing lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:09:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:09:55 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Creating image(s)
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Did not create local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Ensure instance console log exists: /opt/stack/data/nova/instances/6c7bf4ad-7016-44a6-b27a-6dac06f10bda/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Start _get_guest_xml network_info=[{"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkZsvgGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c7bf4ad-7016-44a6-b27a-6dac06f10bda', 'attached_at': '', 'detached_at': '', 'volume_id': '8910b4cd-fecb-411d-89e6-d63b7023bd44', 'serial': '8910b4cd-fecb-411d-89e6-d63b7023bd44'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '86a7ec77-f736-4605-a84a-3dafd2f762e4', 'volume_type': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:09:55 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:09:55 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkZsvgGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:09:55 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:09:55 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:09:55 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cbe9cb-4636-463d-b54a-93d86eda7ae5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:09:55 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1eef8-0c75-40a2-877c-97e030bc54a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44] added
Nov 28 07:09:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a529e6-03c8-4f16-afeb-ab352e79e9c5]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75d302-623a-4ae1-800d-436096e2212d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkZsvgGd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkZsvgGd" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec6b9e-a390-4541-8c83-bdbecf17f0f4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UkZsvgGd'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa84b93-65c2-41e8-a306-99ca2310c1cb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd745c6-a68f-495a-abeb-4ed918b7a48b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:09:55 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:09:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:09:55 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:09:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a817d9b-cadb-44ea-a2b1-9a1cfa09137d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260]
Nov 28 07:09:55 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260] successful.
Nov 28 07:09:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10417a6d-6550-470e-b1f0-66455bb2b8ee]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5078ce5-487a-4909-b9e7-e43c845c66f9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:09:55 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:09:55 user nova-compute[74870]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)
Nov 28 07:09:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:09:55 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:09:55 user nova-compute[74870]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)
Nov 28 07:09:55 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db6cd8b-1d75-476c-88f1-a250c300f060]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:09:55 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkZsvgGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26330623666613062', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330623666613062', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493339524',display_name='tempest-TestVolumeBootPattern-server-1493339524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1493339524',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-m76cdo0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:09:48Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=6c7bf4ad-7016-44a6-b27a-6dac06f10bda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c7bf4ad-7016-44a6-b27a-6dac06f10bda {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:09:56 user nova-compute[74870]:   <uuid>6c7bf4ad-7016-44a6-b27a-6dac06f10bda</uuid>
Nov 28 07:09:56 user nova-compute[74870]:   <name>instance-00000032</name>
Nov 28 07:09:56 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:09:56 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:09:56 user nova-compute[74870]:   <metadata>
Nov 28 07:09:56 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:09:56 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:09:56 user nova-compute[74870]:       <nova:name>tempest-TestVolumeBootPattern-server-1493339524</nova:name>
Nov 28 07:09:56 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:09:55</nova:creationTime>
Nov 28 07:09:56 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:09:56 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:09:56 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:09:56 user nova-compute[74870]:       <nova:owner>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:user uuid="2139976b453e4bd2b8e83e551a0cc772">tempest-TestVolumeBootPattern-1541228194-project-member</nova:user>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:project uuid="cecfa8e54acf42a8affd8686f500d6c9">tempest-TestVolumeBootPattern-1541228194</nova:project>
Nov 28 07:09:56 user nova-compute[74870]:       </nova:owner>
Nov 28 07:09:56 user nova-compute[74870]:       <nova:ports>
Nov 28 07:09:56 user nova-compute[74870]:         <nova:port uuid="663ecf4e-8168-49a1-80d0-f13f491f4b06">
Nov 28 07:09:56 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 07:09:56 user nova-compute[74870]:         </nova:port>
Nov 28 07:09:56 user nova-compute[74870]:       </nova:ports>
Nov 28 07:09:56 user nova-compute[74870]:     </nova:instance>
Nov 28 07:09:56 user nova-compute[74870]:   </metadata>
Nov 28 07:09:56 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:09:56 user nova-compute[74870]:     <system>
Nov 28 07:09:56 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:09:56 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:09:56 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:09:56 user nova-compute[74870]:       <entry name="serial">6c7bf4ad-7016-44a6-b27a-6dac06f10bda</entry>
Nov 28 07:09:56 user nova-compute[74870]:       <entry name="uuid">6c7bf4ad-7016-44a6-b27a-6dac06f10bda</entry>
Nov 28 07:09:56 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:09:56 user nova-compute[74870]:     </system>
Nov 28 07:09:56 user nova-compute[74870]:   </sysinfo>
Nov 28 07:09:56 user nova-compute[74870]:   <os>
Nov 28 07:09:56 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:09:56 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:09:56 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:09:56 user nova-compute[74870]:   </os>
Nov 28 07:09:56 user nova-compute[74870]:   <features>
Nov 28 07:09:56 user nova-compute[74870]:     <acpi/>
Nov 28 07:09:56 user nova-compute[74870]:     <apic/>
Nov 28 07:09:56 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:09:56 user nova-compute[74870]:   </features>
Nov 28 07:09:56 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:09:56 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:09:56 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:09:56 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:09:56 user nova-compute[74870]:   </clock>
Nov 28 07:09:56 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:09:56 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:09:56 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:09:56 user nova-compute[74870]:   </cpu>
Nov 28 07:09:56 user nova-compute[74870]:   <devices>
Nov 28 07:09:56 user nova-compute[74870]:     <disk type="block" device="disk">
Nov 28 07:09:56 user nova-compute[74870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:09:56 user nova-compute[74870]:       <source dev="/dev/sdb"/>
Nov 28 07:09:56 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:09:56 user nova-compute[74870]:       <serial>8910b4cd-fecb-411d-89e6-d63b7023bd44</serial>
Nov 28 07:09:56 user nova-compute[74870]:     </disk>
Nov 28 07:09:56 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:09:56 user nova-compute[74870]:       <mac address="fa:16:3e:89:a3:74"/>
Nov 28 07:09:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:09:56 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:09:56 user nova-compute[74870]:       <target dev="tap663ecf4e-81"/>
Nov 28 07:09:56 user nova-compute[74870]:     </interface>
Nov 28 07:09:56 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:09:56 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/6c7bf4ad-7016-44a6-b27a-6dac06f10bda/console.log" append="off"/>
Nov 28 07:09:56 user nova-compute[74870]:     </serial>
Nov 28 07:09:56 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:09:56 user nova-compute[74870]:     <video>
Nov 28 07:09:56 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:09:56 user nova-compute[74870]:     </video>
Nov 28 07:09:56 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:09:56 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:09:56 user nova-compute[74870]:     </rng>
Nov 28 07:09:56 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:09:56 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:09:56 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:09:56 user nova-compute[74870]:     </memballoon>
Nov 28 07:09:56 user nova-compute[74870]:   </devices>
Nov 28 07:09:56 user nova-compute[74870]: </domain>
Nov 28 07:09:56 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493339524',display_name='tempest-TestVolumeBootPattern-server-1493339524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1493339524',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-m76cdo0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:09:48Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=6c7bf4ad-7016-44a6-b27a-6dac06f10bda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG os_vif [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd104758d-548a-53b3-a87f-61c2ce571fee', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap663ecf4e-81, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap663ecf4e-81, col_values=(('qos', UUID('70c2eb59-3c02-4a3b-9e10-b5b443907287')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap663ecf4e-81, col_values=(('external_ids', {'iface-id': '663ecf4e-8168-49a1-80d0-f13f491f4b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:a3:74', 'vm-uuid': '6c7bf4ad-7016-44a6-b27a-6dac06f10bda'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:56 user nova-compute[74870]: INFO os_vif [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81')
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:09:56 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] No VIF found with MAC fa:16:3e:89:a3:74, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:09:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:09:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:09:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:09:58 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:09:58 user nova-compute[74870]: DEBUG nova.compute.manager [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] No waiting events found dispatching network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:09:58 user nova-compute[74870]: WARNING nova.compute.manager [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received unexpected event network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance with vm_state building and task_state spawning.
Nov 28 07:09:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:09:59 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Instance spawned successfully.
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:09:59 user nova-compute[74870]: INFO nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 28 07:09:59 user nova-compute[74870]: DEBUG nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:10:00 user nova-compute[74870]: INFO nova.compute.manager [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Took 12.41 seconds to build instance.
Nov 28 07:10:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:10:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:00 user nova-compute[74870]: DEBUG nova.compute.manager [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] No waiting events found dispatching network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:10:00 user nova-compute[74870]: WARNING nova.compute.manager [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received unexpected event network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance with vm_state active and task_state None.
Nov 28 07:10:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.518s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:10:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:10:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:10:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:10:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG nova.compute.manager [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing instance network info cache due to event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated VIF entry in instance network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG nova.network.neutron [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:10:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing instance network info cache due to event network-changed-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Acquiring lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Acquired lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Refreshing network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:22 user nova-compute[74870]: INFO nova.compute.manager [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Detaching volume d6996258-ad77-4f65-b6c2-ea5ab46cae9d
Nov 28 07:10:22 user nova-compute[74870]: INFO nova.virt.block_device [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Attempting to driver detach volume d6996258-ad77-4f65-b6c2-ea5ab46cae9d from mountpoint /dev/vdb
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Attempting to detach device vdb from instance aa43db78-a43a-4ef1-b458-12fb253aabd0 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:10:22 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:10:22 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 07:10:22 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:10:22 user nova-compute[74870]:   <serial>d6996258-ad77-4f65-b6c2-ea5ab46cae9d</serial>
Nov 28 07:10:22 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 07:10:22 user nova-compute[74870]: </disk>
Nov 28 07:10:22 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:10:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully detached device vdb from instance aa43db78-a43a-4ef1-b458-12fb253aabd0 from the persistent domain config.
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa43db78-a43a-4ef1-b458-12fb253aabd0 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:10:22 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:10:22 user nova-compute[74870]:   <source dev="/dev/sdd"/>
Nov 28 07:10:22 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:10:22 user nova-compute[74870]:   <serial>d6996258-ad77-4f65-b6c2-ea5ab46cae9d</serial>
Nov 28 07:10:22 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 07:10:22 user nova-compute[74870]: </disk>
Nov 28 07:10:22 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updated VIF entry in instance network info cache for port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.network.neutron [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [{"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Releasing lock "refresh_cache-aa43db78-a43a-4ef1-b458-12fb253aabd0" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:10:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:10:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:10:35 user nova-compute[74870]: INFO nova.compute.claims [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Claim successful on node user
Nov 28 07:10:35 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 07:10:35 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.162s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:10:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.policy [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6adcf7b17de430a81e4f3adbb800919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dd9fcfea94665b9b9a97393f442f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:10:36 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Creating image(s)
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "/opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "/opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Successfully created port: ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.475s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:37 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:10:37 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.201519012451172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk 1073741824" returned: 0 in 0.053s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.532s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5c4f1347-91b0-40ac-9190-889e27afba0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.185s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Cannot resize image /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Ensure instance console log exists: /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Successfully updated port: ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquired lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-changed-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.compute.manager [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Refreshing instance network info cache due to event network-changed-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Acquiring lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:10:37 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Releasing lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Instance network_info: |[{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Acquired lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Refreshing network info cache for port ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Start _get_guest_xml network_info=[{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:10:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:10:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-769175374',display_name='tempest-SnapshotDataIntegrityTests-server-769175374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-769175374',id=51,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3NrfXE/HrSeGiVxVbPsssOqTBM+VWsglMxdYixhqCA8Ly6ap7KrPQ6mUDJggU4QVaW7QjiWuqoy4r2ZNqGY/uAA8z2NhInCXcANojwzpuXmUChkJln9MGwgR9qpzyREg==',key_name='tempest-keypair-1050103458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799dd9fcfea94665b9b9a97393f442f2',ramdisk_id='',reservation_id='r-45v95yry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-29578551',owner_user_name='tempest-SnapshotDataIntegrityTests-29578551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6adcf7b17de430a81e4f3adbb800919',uuid=bdcf8d61-12d6-4698-9c25-907b4cdaf294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Converting VIF {"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'pci_devices' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:10:38 user nova-compute[74870]:   <uuid>bdcf8d61-12d6-4698-9c25-907b4cdaf294</uuid>
Nov 28 07:10:38 user nova-compute[74870]:   <name>instance-00000033</name>
Nov 28 07:10:38 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:10:38 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:10:38 user nova-compute[74870]:   <metadata>
Nov 28 07:10:38 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:10:38 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:10:38 user nova-compute[74870]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-769175374</nova:name>
Nov 28 07:10:38 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:10:38</nova:creationTime>
Nov 28 07:10:38 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:10:38 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:10:38 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:10:38 user nova-compute[74870]:       <nova:owner>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:user uuid="c6adcf7b17de430a81e4f3adbb800919">tempest-SnapshotDataIntegrityTests-29578551-project-member</nova:user>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:project uuid="799dd9fcfea94665b9b9a97393f442f2">tempest-SnapshotDataIntegrityTests-29578551</nova:project>
Nov 28 07:10:38 user nova-compute[74870]:       </nova:owner>
Nov 28 07:10:38 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 07:10:38 user nova-compute[74870]:       <nova:ports>
Nov 28 07:10:38 user nova-compute[74870]:         <nova:port uuid="ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20">
Nov 28 07:10:38 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 07:10:38 user nova-compute[74870]:         </nova:port>
Nov 28 07:10:38 user nova-compute[74870]:       </nova:ports>
Nov 28 07:10:38 user nova-compute[74870]:     </nova:instance>
Nov 28 07:10:38 user nova-compute[74870]:   </metadata>
Nov 28 07:10:38 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:10:38 user nova-compute[74870]:     <system>
Nov 28 07:10:38 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:10:38 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:10:38 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:10:38 user nova-compute[74870]:       <entry name="serial">bdcf8d61-12d6-4698-9c25-907b4cdaf294</entry>
Nov 28 07:10:38 user nova-compute[74870]:       <entry name="uuid">bdcf8d61-12d6-4698-9c25-907b4cdaf294</entry>
Nov 28 07:10:38 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:10:38 user nova-compute[74870]:     </system>
Nov 28 07:10:38 user nova-compute[74870]:   </sysinfo>
Nov 28 07:10:38 user nova-compute[74870]:   <os>
Nov 28 07:10:38 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:10:38 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:10:38 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:10:38 user nova-compute[74870]:   </os>
Nov 28 07:10:38 user nova-compute[74870]:   <features>
Nov 28 07:10:38 user nova-compute[74870]:     <acpi/>
Nov 28 07:10:38 user nova-compute[74870]:     <apic/>
Nov 28 07:10:38 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:10:38 user nova-compute[74870]:   </features>
Nov 28 07:10:38 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:10:38 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:10:38 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:10:38 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:10:38 user nova-compute[74870]:   </clock>
Nov 28 07:10:38 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:10:38 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:10:38 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:10:38 user nova-compute[74870]:   </cpu>
Nov 28 07:10:38 user nova-compute[74870]:   <devices>
Nov 28 07:10:38 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:10:38 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:10:38 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk"/>
Nov 28 07:10:38 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:10:38 user nova-compute[74870]:     </disk>
Nov 28 07:10:38 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:10:38 user nova-compute[74870]:       <mac address="fa:16:3e:e8:89:6d"/>
Nov 28 07:10:38 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:10:38 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:10:38 user nova-compute[74870]:       <target dev="tapecf75c9d-e8"/>
Nov 28 07:10:38 user nova-compute[74870]:     </interface>
Nov 28 07:10:38 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:10:38 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/console.log" append="off"/>
Nov 28 07:10:38 user nova-compute[74870]:     </serial>
Nov 28 07:10:38 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:10:38 user nova-compute[74870]:     <video>
Nov 28 07:10:38 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:10:38 user nova-compute[74870]:     </video>
Nov 28 07:10:38 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:10:38 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:10:38 user nova-compute[74870]:     </rng>
Nov 28 07:10:38 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:10:38 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:10:38 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:10:38 user nova-compute[74870]:     </memballoon>
Nov 28 07:10:38 user nova-compute[74870]:   </devices>
Nov 28 07:10:38 user nova-compute[74870]: </domain>
Nov 28 07:10:38 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-769175374',display_name='tempest-SnapshotDataIntegrityTests-server-769175374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-769175374',id=51,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3NrfXE/HrSeGiVxVbPsssOqTBM+VWsglMxdYixhqCA8Ly6ap7KrPQ6mUDJggU4QVaW7QjiWuqoy4r2ZNqGY/uAA8z2NhInCXcANojwzpuXmUChkJln9MGwgR9qpzyREg==',key_name='tempest-keypair-1050103458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799dd9fcfea94665b9b9a97393f442f2',ramdisk_id='',reservation_id='r-45v95yry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-29578551',owner_user_name='tempest-SnapshotDataIntegrityTests-29578551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6adcf7b17de430a81e4f3adbb800919',uuid=bdcf8d61-12d6-4698-9c25-907b4cdaf294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Converting VIF {"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG os_vif [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '599966cc-4e23-59ea-bd1d-54741c55501f', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecf75c9d-e8, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecf75c9d-e8, col_values=(('qos', UUID('2d14bad4-8c57-4284-861b-8d2d7030c308')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecf75c9d-e8, col_values=(('external_ids', {'iface-id': 'ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:89:6d', 'vm-uuid': 'bdcf8d61-12d6-4698-9c25-907b4cdaf294'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:38 user nova-compute[74870]: INFO os_vif [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8')
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No VIF found with MAC fa:16:3e:e8:89:6d, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updated VIF entry in instance network info cache for port ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:10:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Releasing lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] No waiting events found dispatching network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:10:39 user nova-compute[74870]: WARNING nova.compute.manager [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received unexpected event network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance with vm_state building and task_state spawning.
Nov 28 07:10:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:10:40 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:10:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Instance spawned successfully.
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] No waiting events found dispatching network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:10:41 user nova-compute[74870]: WARNING nova.compute.manager [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received unexpected event network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance with vm_state building and task_state spawning.
Nov 28 07:10:41 user nova-compute[74870]: INFO nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 28 07:10:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:10:41 user nova-compute[74870]: INFO nova.compute.manager [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Took 6.15 seconds to build instance.
Nov 28 07:10:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.236s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:42 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa43db78-a43a-4ef1-b458-12fb253aabd0 is timed out.
Nov 28 07:10:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully detached device vdb from instance aa43db78-a43a-4ef1-b458-12fb253aabd0 from the live domain config.
Nov 28 07:10:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgvJHMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:10:42 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b8a9d9-2e0a-4070-b2a6-af6187b7c48b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:10:42 user nova-compute[74870]: No targets found.
Nov 28 07:10:42 user nova-compute[74870]: iSNS:
Nov 28 07:10:42 user nova-compute[74870]: No targets found.
Nov 28 07:10:42 user nova-compute[74870]: STATIC:
Nov 28 07:10:42 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d
Nov 28 07:10:42 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:10:42 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:10:42 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44
Nov 28 07:10:42 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:10:42 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:10:42 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:10:42 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:10:42 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:10:42 user nova-compute[74870]: FIRMWARE:
Nov 28 07:10:42 user nova-compute[74870]: No targets found.
Nov 28 07:10:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:10:42 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:10:42 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[811fb1f2-38d5-42f6-89a0-c2559324c3c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a97a1a-ca0b-4b52-8a43-350c2895c683]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:10:42 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:10:42 user nova-compute[74870]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)
Nov 28 07:10:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:10:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:10:42 user nova-compute[74870]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d (non-flash)
Nov 28 07:10:42 user nova-compute[74870]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)
Nov 28 07:10:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefd1d1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d'): ({'sdd'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Removing single pathed devices sdd {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6346620c-523b-4cb3-832d-50fb15003261]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea353787-99b3-4b2f-8e74-c055c5bdb1d9]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flushing IO for device /dev/sdd {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6540b4-c291-45e4-a0f8-3ba0a2bc7bcc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea7f2fc-d71f-4299-bb93-9fc57e1eadc0]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] SCSI volumes sdd have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd18d8-abc2-44c8-811e-0518980e4eb1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca26da57-fe0e-4d37-9e50-6001991e7380]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260]
Nov 28 07:10:43 user nova-compute[74870]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d, portal: 172.16.0.220,3260] successful.
Nov 28 07:10:43 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6996258-ad77-4f65-b6c2-ea5ab46cae9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a074eee9-b6c0-461d-ad70-b3bd7a0b80a4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== disconnect_volume: return (330ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:10:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:44 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'flavor' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:10:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:10:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:10:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:57 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:10:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:10:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:16 user nova-compute[74870]: INFO nova.compute.manager [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Terminating instance
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.compute.manager [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Instance destroyed successfully.
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.objects.instance [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'resources' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-51240574',display_name='tempest-TestMinimumBasicScenario-server-51240574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-51240574',id=48,image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA==',key_name='tempest-TestMinimumBasicScenario-1018447659',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-c74f3fun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d3a1e6c9-018f-495e-8204-f598e626c948',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:08:37Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=aa43db78-a43a-4ef1-b458-12fb253aabd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "address": "fa:16:3e:6a:7e:e2", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce415bb-a4", "ovs_interfaceid": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG os_vif [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ce415bb-a4, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac43ef32-ade9-4f99-a0cf-7974acf47413) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:16 user nova-compute[74870]: INFO os_vif [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7e:e2,bridge_name='br-int',has_traffic_filtering=True,id=7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce415bb-a4')
Nov 28 07:11:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Deleting instance files /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0_del
Nov 28 07:11:16 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Deletion of /opt/stack/data/nova/instances/aa43db78-a43a-4ef1-b458-12fb253aabd0_del complete
Nov 28 07:11:17 user nova-compute[74870]: INFO nova.compute.manager [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 07:11:17 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:11:17 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Took 0.57 seconds to deallocate network for instance.
Nov 28 07:11:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-deleted-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:11:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:17 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Deleted allocations for instance aa43db78-a43a-4ef1-b458-12fb253aabd0
Nov 28 07:11:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:18 user nova-compute[74870]: WARNING nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state deleted and task_state None.
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:18 user nova-compute[74870]: WARNING nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state deleted and task_state None.
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:18 user nova-compute[74870]: WARNING nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state deleted and task_state None.
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:18 user nova-compute[74870]: WARNING nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-unplugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state deleted and task_state None.
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Acquiring lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "aa43db78-a43a-4ef1-b458-12fb253aabd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:18 user nova-compute[74870]: DEBUG nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] No waiting events found dispatching network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:18 user nova-compute[74870]: WARNING nova.compute.manager [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Received unexpected event network-vif-plugged-7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance with vm_state deleted and task_state None.
Nov 28 07:11:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:26 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:31 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:35 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:11:36 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:11:36 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:11:36 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.199878692626953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5c4f1347-91b0-40ac-9190-889e27afba0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:11:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 5c4f1347-91b0-40ac-9190-889e27afba0b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-changed-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Refreshing instance network info cache due to event network-changed-663ecf4e-8168-49a1-80d0-f13f491f4b06. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Acquiring lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Acquired lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Refreshing network info cache for port 663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updated VIF entry in instance network info cache for port 663ecf4e-8168-49a1-80d0-f13f491f4b06. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updating instance_info_cache with network_info: [{"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Releasing lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:11:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-changed-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Refreshing instance network info cache due to event network-changed-663ecf4e-8168-49a1-80d0-f13f491f4b06. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Acquiring lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Acquired lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Refreshing network info cache for port 663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:41 user nova-compute[74870]: INFO nova.compute.manager [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Terminating instance
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-vif-unplugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] No waiting events found dispatching network-vif-unplugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-vif-unplugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updated VIF entry in instance network info cache for port 663ecf4e-8168-49a1-80d0-f13f491f4b06. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.network.neutron [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updating instance_info_cache with network_info: [{"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Releasing lock "refresh_cache-6c7bf4ad-7016-44a6-b27a-6dac06f10bda" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:11:41 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Instance destroyed successfully.
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'resources' on Instance uuid 6c7bf4ad-7016-44a6-b27a-6dac06f10bda {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493339524',display_name='tempest-TestVolumeBootPattern-server-1493339524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1493339524',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:09:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-m76cdo0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:10:00Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=6c7bf4ad-7016-44a6-b27a-6dac06f10bda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "address": "fa:16:3e:89:a3:74", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ecf4e-81", "ovs_interfaceid": "663ecf4e-8168-49a1-80d0-f13f491f4b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_vif [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap663ecf4e-81, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70c2eb59-3c02-4a3b-9e10-b5b443907287) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:11:41 user nova-compute[74870]: INFO os_vif [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=663ecf4e-8168-49a1-80d0-f13f491f4b06,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ecf4e-81')
Nov 28 07:11:41 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkZsvgGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:11:41 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd497c-9847-4afd-973c-7d58fd3b1072]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:11:41 user nova-compute[74870]: No targets found.
Nov 28 07:11:41 user nova-compute[74870]: iSNS:
Nov 28 07:11:41 user nova-compute[74870]: No targets found.
Nov 28 07:11:41 user nova-compute[74870]: STATIC:
Nov 28 07:11:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44
Nov 28 07:11:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:11:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:11:41 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:11:41 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:11:41 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:11:41 user nova-compute[74870]: FIRMWARE:
Nov 28 07:11:41 user nova-compute[74870]: No targets found.
Nov 28 07:11:41 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:11:41 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:11:41 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:11:41 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b862a4-0301-4ed2-b74b-06db12b575f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70dea31-d776-435e-b379-75f3891acb14]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:11:42 user nova-compute[74870]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)
Nov 28 07:11:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:11:42 user nova-compute[74870]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 (non-flash)
Nov 28 07:11:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc515ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[399646cc-bbea-47bc-89e3-b28d38375cf7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db59938-1d66-4f11-a4ef-6fb32340ea8d]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70fb7b-6d8d-4e8b-9522-e6d9843f247b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d619c19-ae5c-48f4-8ffe-beac0fab7e8d]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee369f74-0531-4885-99c9-1ae325e9cca2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b74d329-dc8a-4318-88ce-493f9a31bd46]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260]
Nov 28 07:11:42 user nova-compute[74870]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44, portal: 172.16.0.220,3260] successful.
Nov 28 07:11:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8910b4cd-fecb-411d-89e6-d63b7023bd44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29f08a-3769-4c02-b4d9-5d018863da52]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== disconnect_volume: return (275ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:11:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Deleting instance files /opt/stack/data/nova/instances/6c7bf4ad-7016-44a6-b27a-6dac06f10bda_del
Nov 28 07:11:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Deletion of /opt/stack/data/nova/instances/6c7bf4ad-7016-44a6-b27a-6dac06f10bda_del complete
Nov 28 07:11:42 user nova-compute[74870]: INFO nova.compute.manager [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 07:11:42 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:11:42 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:11:43 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Took 0.78 seconds to deallocate network for instance.
Nov 28 07:11:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-vif-deleted-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received event network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Acquiring lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG nova.compute.manager [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] No waiting events found dispatching network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:11:43 user nova-compute[74870]: WARNING nova.compute.manager [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Received unexpected event network-vif-plugged-663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance with vm_state active and task_state deleting.
Nov 28 07:11:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:43 user nova-compute[74870]: INFO nova.compute.manager [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Took 0.74 seconds to detach 1 volumes for instance.
Nov 28 07:11:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:11:43 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:11:44 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:11:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:44 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Deleted allocations for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda
Nov 28 07:11:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "6c7bf4ad-7016-44a6-b27a-6dac06f10bda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:11:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:46 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:11:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:11:51 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:11:56 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:06 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:09 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:12:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:09 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:12:09 user nova-compute[74870]: INFO nova.compute.claims [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Claim successful on node user
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:12:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.policy [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:12:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Creating image(s)
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "/opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "/opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "9421b93360eacd19c5c66057d48533bb7a53c0ae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "9421b93360eacd19c5c66057d48533bb7a53c0ae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.part --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Successfully created port: 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.virt.images [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ba067348-4c02-4322-b6fa-c65ea1d8243b was qcow2, converting to raw {{(pid=74870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG nova.privsep.utils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 07:12:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.part /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.converted {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.part /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.converted" returned: 0 in 0.342s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.converted --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "9421b93360eacd19c5c66057d48533bb7a53c0ae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.200s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Successfully updated port: 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-changed-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG nova.compute.manager [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing instance network info cache due to event network-changed-84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing network info cache for port 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "9421b93360eacd19c5c66057d48533bb7a53c0ae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "9421b93360eacd19c5c66057d48533bb7a53c0ae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae --force-share --output=json" returned: 0 in 0.169s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae,backing_fmt=raw /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae,backing_fmt=raw /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk 1073741824" returned: 0 in 0.118s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "9421b93360eacd19c5c66057d48533bb7a53c0ae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae --force-share --output=json" returned: 0 in 0.171s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Cannot resize image /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Ensure instance console log exists: /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance network_info: |[{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Start _get_guest_xml network_info=[{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T07:12:07Z,direct_url=<?>,disk_format='qcow2',id=ba067348-4c02-4322-b6fa-c65ea1d8243b,min_disk=0,min_ram=0,name='tempest-scenario-img--392444414',owner='3af4e4870f934158819e183bbc7b499e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T07:12:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'ba067348-4c02-4322-b6fa-c65ea1d8243b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:12:12 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:12:12 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T07:12:07Z,direct_url=<?>,disk_format='qcow2',id=ba067348-4c02-4322-b6fa-c65ea1d8243b,min_disk=0,min_ram=0,name='tempest-scenario-img--392444414',owner='3af4e4870f934158819e183bbc7b499e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T07:12:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1439575737',display_name='tempest-TestMinimumBasicScenario-server-1439575737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1439575737',id=52,image_ref='ba067348-4c02-4322-b6fa-c65ea1d8243b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwPqiZCyo6mJK/w64EvOXbjK3caBU7kucGR/ZC7nBhAgDHRSY1giVJTJl4rBjkMG7le9zRcL3udFSbWodWNaBkhKXsBwWK1O8H0Hg+t+cENiIB2v3o91IrOcSoyndKxHw==',key_name='tempest-TestMinimumBasicScenario-969944734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-ev0gydmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba067348-4c02-4322-b6fa-c65ea1d8243b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:12:10Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:12:12 user nova-compute[74870]:   <uuid>0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b</uuid>
Nov 28 07:12:12 user nova-compute[74870]:   <name>instance-00000034</name>
Nov 28 07:12:12 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:12:12 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:12:12 user nova-compute[74870]:   <metadata>
Nov 28 07:12:12 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:12:12 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:12:12 user nova-compute[74870]:       <nova:name>tempest-TestMinimumBasicScenario-server-1439575737</nova:name>
Nov 28 07:12:12 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:12:12</nova:creationTime>
Nov 28 07:12:12 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:12:12 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:12:12 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:12:12 user nova-compute[74870]:       <nova:owner>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:user uuid="41da15820f7d43dfad1503c8d7355e6c">tempest-TestMinimumBasicScenario-1726429113-project-member</nova:user>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:project uuid="3af4e4870f934158819e183bbc7b499e">tempest-TestMinimumBasicScenario-1726429113</nova:project>
Nov 28 07:12:12 user nova-compute[74870]:       </nova:owner>
Nov 28 07:12:12 user nova-compute[74870]:       <nova:root type="image" uuid="ba067348-4c02-4322-b6fa-c65ea1d8243b"/>
Nov 28 07:12:12 user nova-compute[74870]:       <nova:ports>
Nov 28 07:12:12 user nova-compute[74870]:         <nova:port uuid="84587c86-6386-484a-9255-14e747fdaa68">
Nov 28 07:12:12 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 07:12:12 user nova-compute[74870]:         </nova:port>
Nov 28 07:12:12 user nova-compute[74870]:       </nova:ports>
Nov 28 07:12:12 user nova-compute[74870]:     </nova:instance>
Nov 28 07:12:12 user nova-compute[74870]:   </metadata>
Nov 28 07:12:12 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:12:12 user nova-compute[74870]:     <system>
Nov 28 07:12:12 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:12:12 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:12:12 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:12:12 user nova-compute[74870]:       <entry name="serial">0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b</entry>
Nov 28 07:12:12 user nova-compute[74870]:       <entry name="uuid">0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b</entry>
Nov 28 07:12:12 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:12:12 user nova-compute[74870]:     </system>
Nov 28 07:12:12 user nova-compute[74870]:   </sysinfo>
Nov 28 07:12:12 user nova-compute[74870]:   <os>
Nov 28 07:12:12 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:12:12 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:12:12 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:12:12 user nova-compute[74870]:   </os>
Nov 28 07:12:12 user nova-compute[74870]:   <features>
Nov 28 07:12:12 user nova-compute[74870]:     <acpi/>
Nov 28 07:12:12 user nova-compute[74870]:     <apic/>
Nov 28 07:12:12 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:12:12 user nova-compute[74870]:   </features>
Nov 28 07:12:12 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:12:12 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:12:12 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:12:12 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:12:12 user nova-compute[74870]:   </clock>
Nov 28 07:12:12 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:12:12 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:12:12 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:12:12 user nova-compute[74870]:   </cpu>
Nov 28 07:12:12 user nova-compute[74870]:   <devices>
Nov 28 07:12:12 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:12:12 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:12:12 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk"/>
Nov 28 07:12:12 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:12:12 user nova-compute[74870]:     </disk>
Nov 28 07:12:12 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:12:12 user nova-compute[74870]:       <mac address="fa:16:3e:35:a8:ce"/>
Nov 28 07:12:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:12:12 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:12:12 user nova-compute[74870]:       <target dev="tap84587c86-63"/>
Nov 28 07:12:12 user nova-compute[74870]:     </interface>
Nov 28 07:12:12 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:12:12 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/console.log" append="off"/>
Nov 28 07:12:12 user nova-compute[74870]:     </serial>
Nov 28 07:12:12 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:12:12 user nova-compute[74870]:     <video>
Nov 28 07:12:12 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:12:12 user nova-compute[74870]:     </video>
Nov 28 07:12:12 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:12:12 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:12:12 user nova-compute[74870]:     </rng>
Nov 28 07:12:12 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:12:12 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:12:12 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:12:12 user nova-compute[74870]:     </memballoon>
Nov 28 07:12:12 user nova-compute[74870]:   </devices>
Nov 28 07:12:12 user nova-compute[74870]: </domain>
Nov 28 07:12:12 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1439575737',display_name='tempest-TestMinimumBasicScenario-server-1439575737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1439575737',id=52,image_ref='ba067348-4c02-4322-b6fa-c65ea1d8243b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwPqiZCyo6mJK/w64EvOXbjK3caBU7kucGR/ZC7nBhAgDHRSY1giVJTJl4rBjkMG7le9zRcL3udFSbWodWNaBkhKXsBwWK1O8H0Hg+t+cENiIB2v3o91IrOcSoyndKxHw==',key_name='tempest-TestMinimumBasicScenario-969944734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-ev0gydmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba067348-4c02-4322-b6fa-c65ea1d8243b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:12:10Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG os_vif [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddb20b96-c3a5-5aa9-a1f6-b77aa54f084d', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84587c86-63, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84587c86-63, col_values=(('qos', UUID('5182ef12-588b-4fcf-bcc1-0c814239c804')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84587c86-63, col_values=(('external_ids', {'iface-id': '84587c86-6386-484a-9255-14e747fdaa68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:a8:ce', 'vm-uuid': '0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:12 user nova-compute[74870]: INFO os_vif [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63')
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:12:12 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No VIF found with MAC fa:16:3e:35:a8:ce, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:13 user nova-compute[74870]: DEBUG nova.compute.manager [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:12:13 user nova-compute[74870]: WARNING nova.compute.manager [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state building and task_state spawning.
Nov 28 07:12:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:12:15 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance spawned successfully.
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:12:15 user nova-compute[74870]: INFO nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 28 07:12:15 user nova-compute[74870]: DEBUG nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:12:15 user nova-compute[74870]: INFO nova.compute.manager [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Took 6.20 seconds to build instance.
Nov 28 07:12:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.294s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:16 user nova-compute[74870]: DEBUG nova.compute.manager [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:12:16 user nova-compute[74870]: WARNING nova.compute.manager [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state None.
Nov 28 07:12:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-changed-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:26 user nova-compute[74870]: DEBUG nova.compute.manager [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Refreshing instance network info cache due to event network-changed-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:12:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Acquiring lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:12:26 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Acquired lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:12:26 user nova-compute[74870]: DEBUG nova.network.neutron [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Refreshing network info cache for port ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updated VIF entry in instance network info cache for port ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG nova.network.neutron [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Releasing lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:12:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG nova.objects.instance [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:31 user nova-compute[74870]: INFO nova.compute.manager [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attaching volume 47958c9b-a2df-4beb-b3eb-27c616d1d976 to /dev/vdb
Nov 28 07:12:31 user nova-compute[74870]: DEBUG os_brick.utils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f948c2a-65ed-4e8b-bd54-29aa03d625d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2fdcae-91d6-4c06-81b6-834f9fea9867]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d783eae-d319-4baf-9857-ab6edba789e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f9ba3c-d88b-4375-9db4-b76ddc84b76c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:12:31 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:12:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1518fbc-a54a-473a-8af8-7cf1820f8ecd]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG os_brick.utils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:12:31 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating existing volume attachment record: b62bf231-3c2f-45ac-8852-fdd44fa0085f {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:12:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:36 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:37 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlytCJMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:12:38 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:12:38 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:12:38 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da4cad9-471b-420a-aa46-345a9b655b4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:12:38 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:12:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=25.150177001953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[178fc5af-ef1b-4bb3-a934-5446ccb41567]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976] added
Nov 28 07:12:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a4500-1ab4-4bfd-92ad-452b6098796c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0254ec-62e2-4c0d-851c-078d20b857f4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlytCJMV {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlytCJMV" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[88238499-3e96-4e33-8b2d-12ce85f61f2f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DlytCJMV'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 5c4f1347-91b0-40ac-9190-889e27afba0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13fa5d-238e-47ff-920c-ff4f4b8d75d8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c813274-72f9-4684-9ec8-0de8bcc4c128]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:12:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:12:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-changed-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.manager [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Refreshing instance network info cache due to event network-changed-d7a4564b-b7fb-4f25-8afd-a74624159c8b. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Acquiring lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Acquired lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.network.neutron [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Refreshing network info cache for port d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[98454c0a-b6b8-4851-9771-f06095092d44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260]
Nov 28 07:12:38 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260] successful.
Nov 28 07:12:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa57835-25c3-4143-9078-8c8100065974]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7174a830-11e7-43c3-a009-4a9a9033928e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:12:38 user nova-compute[74870]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)
Nov 28 07:12:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:12:38 user nova-compute[74870]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)
Nov 28 07:12:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.686s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b0a4ce-f33d-4fd5-88d8-ce4e9845923a]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlytCJMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:38 user nova-compute[74870]: INFO nova.compute.manager [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Terminating instance
Nov 28 07:12:38 user nova-compute[74870]: DEBUG nova.compute.manager [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-vif-unplugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] No waiting events found dispatching network-vif-unplugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.compute.manager [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-vif-unplugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updated VIF entry in instance network info cache for port d7a4564b-b7fb-4f25-8afd-a74624159c8b. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.network.neutron [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [{"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Releasing lock "refresh_cache-5c4f1347-91b0-40ac-9190-889e27afba0b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:12:39 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Instance destroyed successfully.
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lazy-loading 'resources' on Instance uuid 5c4f1347-91b0-40ac-9190-889e27afba0b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618794767',display_name='tempest-TestVolumeBootPattern-server-1618794767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618794767',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ==',key_name='tempest-TestVolumeBootPattern-1183583656',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cecfa8e54acf42a8affd8686f500d6c9',ramdisk_id='',reservation_id='r-6bdm78nu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1541228194',owner_user_name='tempest-TestVolumeBootPattern-1541228194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:08:00Z,user_data=None,user_id='2139976b453e4bd2b8e83e551a0cc772',uuid=5c4f1347-91b0-40ac-9190-889e27afba0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converting VIF {"id": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "address": "fa:16:3e:11:2a:b6", "network": {"id": "7d507ecb-7146-47b0-98b6-2939026c2b05", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1954008222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cecfa8e54acf42a8affd8686f500d6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a4564b-b7", "ovs_interfaceid": "d7a4564b-b7fb-4f25-8afd-a74624159c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_vif [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7a4564b-b7, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ee53967-66b1-49dc-be49-138f07276749) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:12:39 user nova-compute[74870]: INFO os_vif [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:2a:b6,bridge_name='br-int',has_traffic_filtering=True,id=d7a4564b-b7fb-4f25-8afd-a74624159c8b,network=Network(7d507ecb-7146-47b0-98b6-2939026c2b05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a4564b-b7')
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPmqnuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:12:39 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.722s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== connect_volume: return (1730ms) {'type': 'block', 'scsi_wwn': '23030633361373830', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030633361373830', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.169s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e5d668-75d9-4179-bfa8-19456bf1a076]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:12:39 user nova-compute[74870]: No targets found.
Nov 28 07:12:39 user nova-compute[74870]: iSNS:
Nov 28 07:12:39 user nova-compute[74870]: No targets found.
Nov 28 07:12:39 user nova-compute[74870]: STATIC:
Nov 28 07:12:39 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976
Nov 28 07:12:39 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:12:39 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:12:39 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861
Nov 28 07:12:39 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:12:39 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:12:39 user nova-compute[74870]: FIRMWARE:
Nov 28 07:12:39 user nova-compute[74870]: No targets found.
Nov 28 07:12:39 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:12:39 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:12:39 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:12:39 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:12:39 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:12:39 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:12:39 user nova-compute[74870]:   <serial>47958c9b-a2df-4beb-b3eb-27c616d1d976</serial>
Nov 28 07:12:39 user nova-compute[74870]: </disk>
Nov 28 07:12:39 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b19efe-47c7-4f07-b11f-d5b31e99fd4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ead60-5cf6-46a8-89a1-aec9c2a3e1fb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:12:39 user nova-compute[74870]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)
Nov 28 07:12:39 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 (non-flash)
Nov 28 07:12:39 user nova-compute[74870]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)
Nov 28 07:12:39 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcef4140790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9737b6e-7f4f-4418-89a3-521f7a4e7f78]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ec4c7-ef53-4ac5-9523-0e864d3fc6e6]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd7b261-b864-42c9-ba06-4d27b71cbbdb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:12:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[776907aa-7add-4b0b-a3fd-d28e6a0099ef]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32acfb-13e9-454f-af68-a24415238a47]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a3d8f-6e8b-49c4-8571-1affa0d4397f]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260]
Nov 28 07:12:40 user nova-compute[74870]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861, portal: 172.16.0.220,3260] successful.
Nov 28 07:12:40 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba423b6-1127-46d5-a9a7-87dd41849861 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05841fad-d80b-4c47-ba58-33fd2fd25c7d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] <== disconnect_volume: return (472ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:12:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Deleting instance files /opt/stack/data/nova/instances/5c4f1347-91b0-40ac-9190-889e27afba0b_del
Nov 28 07:12:40 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Deletion of /opt/stack/data/nova/instances/5c4f1347-91b0-40ac-9190-889e27afba0b_del complete
Nov 28 07:12:40 user nova-compute[74870]: INFO nova.compute.manager [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No VIF found with MAC fa:16:3e:e8:89:6d, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.149s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:12:40 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Took 0.45 seconds to deallocate network for instance.
Nov 28 07:12:40 user nova-compute[74870]: DEBUG nova.compute.manager [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-vif-deleted-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received event network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Acquiring lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.compute.manager [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] No waiting events found dispatching network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:12:41 user nova-compute[74870]: WARNING nova.compute.manager [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Received unexpected event network-vif-plugged-d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance with vm_state active and task_state deleting.
Nov 28 07:12:41 user nova-compute[74870]: INFO nova.compute.manager [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:41 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Deleted allocations for instance 5c4f1347-91b0-40ac-9190-889e27afba0b
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:12:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "5c4f1347-91b0-40ac-9190-889e27afba0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:12:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:12:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:12:54 user nova-compute[74870]: INFO nova.compute.manager [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Detaching volume 47958c9b-a2df-4beb-b3eb-27c616d1d976
Nov 28 07:12:54 user nova-compute[74870]: INFO nova.virt.block_device [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attempting to driver detach volume 47958c9b-a2df-4beb-b3eb-27c616d1d976 from mountpoint /dev/vdb
Nov 28 07:12:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Attempting to detach device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:12:54 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:12:54 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:12:54 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:12:54 user nova-compute[74870]:   <serial>47958c9b-a2df-4beb-b3eb-27c616d1d976</serial>
Nov 28 07:12:54 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:12:54 user nova-compute[74870]: </disk>
Nov 28 07:12:54 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:12:54 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config.
Nov 28 07:12:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:12:54 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:12:54 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:12:54 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:12:54 user nova-compute[74870]:   <serial>47958c9b-a2df-4beb-b3eb-27c616d1d976</serial>
Nov 28 07:12:54 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:12:54 user nova-compute[74870]: </disk>
Nov 28 07:12:54 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:54 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:12:58 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:12:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:12:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:14 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 is timed out.
Nov 28 07:13:14 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config.
Nov 28 07:13:14 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlytCJMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:13:14 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:13:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[590cca8d-739b-4be4-a674-c11c19527284]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:13:14 user nova-compute[74870]: No targets found.
Nov 28 07:13:14 user nova-compute[74870]: iSNS:
Nov 28 07:13:14 user nova-compute[74870]: No targets found.
Nov 28 07:13:14 user nova-compute[74870]: STATIC:
Nov 28 07:13:14 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976
Nov 28 07:13:14 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:13:14 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:13:14 user nova-compute[74870]: FIRMWARE:
Nov 28 07:13:14 user nova-compute[74870]: No targets found.
Nov 28 07:13:14 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:13:14 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:13:14 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:13:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0903c7c-290f-4733-bc87-b9115a4bc2fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d882fa54-a0db-4889-aba1-d006ecb3392b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)
Nov 28 07:13:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 (non-flash)
Nov 28 07:13:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefd1d1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eef0c0-b9bc-40e3-80f5-1465a6f839e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0358cd63-0557-460e-a149-8ce9441e5948]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac42133-819e-4fbf-818b-704d38901f6a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f228b5fd-db2f-4cb5-bea6-6ae65686eb6d]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c8d0f-f206-49d8-b151-7cf74762f5dc]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc92554-0858-484a-a3b5-32e0d154a9be]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260]
Nov 28 07:13:15 user nova-compute[74870]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976, portal: 172.16.0.220,3260] successful.
Nov 28 07:13:15 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47958c9b-a2df-4beb-b3eb-27c616d1d976 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1048c2c-925d-44f5-ad47-eb2fa367502e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== disconnect_volume: return (304ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:13:15 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:13:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.632s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:13:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:13:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:13:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:13:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:36 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:37 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:13:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.138988494873047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:13:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:13:43 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:13:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:13:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:13:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:13:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:13:47 user nova-compute[74870]: INFO nova.compute.manager [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attaching volume 407b078b-36cb-4a8a-9a6e-d7064d103577 to /dev/vdb
Nov 28 07:13:47 user nova-compute[74870]: DEBUG os_brick.utils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb04b8-4c27-4d46-b719-69e1f58696a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf39ea19-53a0-41d1-9321-ac01b3ba3512]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f26fa-d7b7-469a-82fb-c4ae31ff2f79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9bcdc5-b3d7-4f68-9ac5-f033ba2a8673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:13:47 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:13:47 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efa304-e2a0-419a-a889-ad91e7c2be3f]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG os_brick.utils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:13:47 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating existing volume attachment record: 6d2f612b-1254-4730-8ba7-4f8ea021fc8a {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:13:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:13:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:53 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:13:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlozQwkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:13:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:13:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:13:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:13:53 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:13:53 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:13:54 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e5a430-6fb5-4124-8d1a-d315c3c575b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:13:54 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e7761-a331-422f-ab4c-26c0a59aef76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577] added
Nov 28 07:13:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d77e3-cb95-4cae-9e81-d2d3cce11ae2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0baded5-90e3-46bf-a160-d8a3fcd21ebb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlozQwkd {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlozQwkd" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3078aa-de8f-490d-8bcf-2e43c6f2284a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlozQwkd'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da88d25-c767-4f07-85a9-af862f1218e6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd937d8-caef-45f9-9795-df4dc24ff778]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:13:54 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:13:54 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:13:54 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 07:13:54 user nova-compute[74870]: 
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65733b2c-628d-4c6e-bd19-ec8de78552db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260]
Nov 28 07:13:54 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260] successful.
Nov 28 07:13:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b5df3-de89-4dd9-8305-40a7f7eeeff8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb0ce4-6d4b-4317-973f-ebcf7d4a269c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:13:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:13:54 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fe4a0e-844a-4027-8e03-1ad645dbf4f3]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlozQwkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:13:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23464653661353334', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464653661353334', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:13:55 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:13:55 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:13:55 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:13:55 user nova-compute[74870]:   <serial>407b078b-36cb-4a8a-9a6e-d7064d103577</serial>
Nov 28 07:13:55 user nova-compute[74870]: </disk>
Nov 28 07:13:55 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No VIF found with MAC fa:16:3e:e8:89:6d, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:13:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.292s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:13:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:13:57 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:13:57 user nova-compute[74870]: INFO nova.compute.manager [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Detaching volume 407b078b-36cb-4a8a-9a6e-d7064d103577
Nov 28 07:13:57 user nova-compute[74870]: INFO nova.virt.block_device [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attempting to driver detach volume 407b078b-36cb-4a8a-9a6e-d7064d103577 from mountpoint /dev/vdb
Nov 28 07:13:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Attempting to detach device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:13:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:13:57 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:13:57 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:13:57 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:13:57 user nova-compute[74870]:   <serial>407b078b-36cb-4a8a-9a6e-d7064d103577</serial>
Nov 28 07:13:57 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:13:57 user nova-compute[74870]: </disk>
Nov 28 07:13:57 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:13:57 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config.
Nov 28 07:13:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:13:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:13:57 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:13:57 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:13:57 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:13:57 user nova-compute[74870]:   <serial>407b078b-36cb-4a8a-9a6e-d7064d103577</serial>
Nov 28 07:13:57 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:13:57 user nova-compute[74870]: </disk>
Nov 28 07:13:57 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:13:58 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:13:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:13:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'flavor' on Instance uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:03 user nova-compute[74870]: INFO nova.compute.manager [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Attaching volume 5009fb21-cca6-4be0-ab41-0f287101a623 to /dev/vdb
Nov 28 07:14:03 user nova-compute[74870]: DEBUG os_brick.utils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ade64-4449-4c2c-8e25-6d88e8a00f37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02606fdd-2deb-4ede-b357-1c101fced6e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d31428-55b5-485e-bc55-dd812e660f1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af981317-5d74-4b6d-bca6-4fe54313aa89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:14:03 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:14:03 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dffe671-4064-4bfe-90da-5cbc8bc0c30c]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG os_brick.utils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:14:03 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating existing volume attachment record: 0fbede4f-6a62-42e8-822c-3b52bdffa0f8 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Verify base images {{(pid=74870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Image id ba067348-4c02-4322-b6fa-c65ea1d8243b yields fingerprint 9421b93360eacd19c5c66057d48533bb7a53c0ae {{(pid=74870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] image ba067348-4c02-4322-b6fa-c65ea1d8243b at (/opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae): checking
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] image ba067348-4c02-4322-b6fa-c65ea1d8243b at (/opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae): image is in use {{(pid=74870) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Image id f62a76e5-f00c-416b-84d0-db9b754396ab yields fingerprint f17719a5f0481537c6d4d509b80e0c447185ae6c {{(pid=74870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] image f62a76e5-f00c-416b-84d0-db9b754396ab at (/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c): checking
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] image f62a76e5-f00c-416b-84d0-db9b754396ab at (/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c): image is in use {{(pid=74870) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b is a valid instance name {{(pid=74870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b has a disk file {{(pid=74870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b is backed by 9421b93360eacd19c5c66057d48533bb7a53c0ae {{(pid=74870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] bdcf8d61-12d6-4698-9c25-907b4cdaf294 is a valid instance name {{(pid=74870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] bdcf8d61-12d6-4698-9c25-907b4cdaf294 has a disk file {{(pid=74870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 is backed by f17719a5f0481537c6d4d509b80e0c447185ae6c {{(pid=74870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401
Nov 28 07:14:04 user nova-compute[74870]: WARNING nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Unknown base file: /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Active base files: /opt/stack/data/nova/instances/_base/9421b93360eacd19c5c66057d48533bb7a53c0ae /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Removable base files: /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8 /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5 /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401 /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05803b2bea107ddc79145e4db15684ca3d2e84c8
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a2c8aee25d33c5322795cfee7c4beaa9da0689bb
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aaefb9b77cd12cd97d698ac9f1e9f373503bd4d5
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34fcd68dbbacf361bad4da59d1c58d11ddc4dfcc
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cca08c9430bc778a6551a6a0315d2c300439773b
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b948e4c678f976d97f0635ff49f7be7ec98d4fce
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e38affa7da923bc59562cad39f8590eb26880401
Nov 28 07:14:04 user nova-compute[74870]: INFO nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/54398da752d8dcac0a9e2c7766574b69449fb72e
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Verification complete {{(pid=74870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Verify swap images {{(pid=74870) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.imagecache [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Verify ephemeral images {{(pid=74870) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 07:14:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMykjQBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:14:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:14:10 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:14:10 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f9b01-1435-4c68-8e9d-ae818c7a620a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:14:10 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac5709-b924-4cfa-aba1-0a241f007a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623] added
Nov 28 07:14:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b376a1e-1796-425e-b7a1-744b9111d10a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec83eb0-f262-4238-9f7d-a71d56e6bf7a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMykjQBE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMykjQBE" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b199f547-162f-4e07-a9a5-8d26061cd3f4]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMykjQBE'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c150a91d-acbc-43ce-b453-3d6da474b00a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a4afde-5fea-4092-84d6-d8229f5aba67]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:14:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:14:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cdceb0-a99e-4dd0-b6ee-971e3e05b664]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260]
Nov 28 07:14:10 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260] successful.
Nov 28 07:14:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24249be9-8ac0-431b-a769-6945cececf41]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f690099f-aa8f-4119-8183-97f053ef2a40]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:14:10 user nova-compute[74870]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:14:10 user nova-compute[74870]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:10 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea9b0d7-9846-4e54-8ea1-7d2898f44b68]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:10 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMykjQBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23937393438666662', 'path': '/dev/sdc'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937393438666662', 'path': '/dev/sdc'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'flavor' on Instance uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:14:11 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:14:11 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 07:14:11 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:14:11 user nova-compute[74870]:   <serial>5009fb21-cca6-4be0-ab41-0f287101a623</serial>
Nov 28 07:14:11 user nova-compute[74870]: </disk>
Nov 28 07:14:11 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] No VIF found with MAC fa:16:3e:35:a8:ce, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:14:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.500s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-changed-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:14 user nova-compute[74870]: DEBUG nova.compute.manager [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing instance network info cache due to event network-changed-84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:14:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:14:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:14:14 user nova-compute[74870]: DEBUG nova.network.neutron [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing network info cache for port 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:14:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updated VIF entry in instance network info cache for port 84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:14:15 user nova-compute[74870]: DEBUG nova.network.neutron [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:14:15 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-changed-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG nova.compute.manager [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing instance network info cache due to event network-changed-84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing network info cache for port 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updated VIF entry in instance network info cache for port 84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG nova.network.neutron [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:17 user nova-compute[74870]: INFO nova.compute.manager [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Rebooting instance
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:14:17 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG nova.network.neutron [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:14:18 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 is timed out.
Nov 28 07:14:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config.
Nov 28 07:14:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlozQwkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:14:18 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a8c4e2-d88f-4a65-aa52-d6520257acca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:14:18 user nova-compute[74870]: No targets found.
Nov 28 07:14:18 user nova-compute[74870]: iSNS:
Nov 28 07:14:18 user nova-compute[74870]: No targets found.
Nov 28 07:14:18 user nova-compute[74870]: STATIC:
Nov 28 07:14:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577
Nov 28 07:14:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:14:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:14:18 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623
Nov 28 07:14:18 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:14:18 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:14:18 user nova-compute[74870]: FIRMWARE:
Nov 28 07:14:18 user nova-compute[74870]: No targets found.
Nov 28 07:14:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:14:18 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:14:18 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d3d90-2cce-4e66-893a-87e8387f9202]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc1ab1-af6e-4b28-b6e7-e26a24b399df]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:14:18 user nova-compute[74870]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 (non-flash)
Nov 28 07:14:18 user nova-compute[74870]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefd1d2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1dc30-8dde-4e97-97a4-fb85c89e800e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[525b09df-365a-4863-b135-029d30103229]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436fbf6-50bc-4d12-beda-560a48291169]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7578d075-3948-48c0-8c61-c166dc0514ce]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc737b1-6f55-452c-954d-fde36ac7a0eb]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5942a817-e6d9-4c97-b97e-9afbc42b5075]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260]
Nov 28 07:14:18 user nova-compute[74870]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577, portal: 172.16.0.220,3260] successful.
Nov 28 07:14:18 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407b078b-36cb-4a8a-9a6e-d7064d103577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565cfc4-9839-4580-9fb3-7085b2869e7f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== disconnect_volume: return (271ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:14:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:14:19 user nova-compute[74870]: DEBUG nova.objects.instance [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:14:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:20 user nova-compute[74870]: DEBUG nova.compute.manager [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:20 user nova-compute[74870]: WARNING nova.compute.manager [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance shutdown successfully.
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:21 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:22 user nova-compute[74870]: WARNING nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:22 user nova-compute[74870]: WARNING nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:22 user nova-compute[74870]: WARNING nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:22 user nova-compute[74870]: WARNING nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:22 user nova-compute[74870]: WARNING nova.compute.manager [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:24 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance running successfully.
Nov 28 07:14:24 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance soft rebooted successfully.
Nov 28 07:14:24 user nova-compute[74870]: DEBUG nova.compute.manager [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:24 user nova-compute[74870]: WARNING nova.compute.manager [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:14:24 user nova-compute[74870]: WARNING nova.compute.manager [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state active and task_state reboot_started.
Nov 28 07:14:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.102s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:14:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:14:40 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.136428833007812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:14:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:14:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:45 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:14:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:14:45 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:14:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:14:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 07:14:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG nova.objects.instance [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:14:51 user nova-compute[74870]: INFO nova.compute.manager [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attaching volume 6b7cc2c3-314a-427b-a874-d196a20f6370 to /dev/vdb
Nov 28 07:14:51 user nova-compute[74870]: DEBUG os_brick.utils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16abf9fb-6feb-4ebe-943b-78e664baeabf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b1df00-2b5a-4c86-87fc-8a4f56ca4c78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f200150b-e1d4-414b-aff2-d3d381da4e3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2b3b0c-70eb-4001-a3ac-3f7ece2b313c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:14:51 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:14:51 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc83c561-3c40-457f-a77c-ffaf9e236bc6]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG os_brick.utils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:14:51 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating existing volume attachment record: ffa26165-8c57-4adc-a9c9-2e3b5f2981da {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:14:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:14:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 07:14:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 07:14:56 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NElzDRty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:14:57 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:14:57 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:14:57 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ba79a-c485-41f7-945f-4c98ef50e92d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:14:57 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f788ff-13d9-4310-86b8-aca900e21186]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370] added
Nov 28 07:14:57 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba04e4d-c6f9-45d5-ac67-5dce943c9ca3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8141f04-093f-4dd6-a032-1237a438df50]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:57 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NElzDRty {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NElzDRty" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc5e635-fa65-4daf-a0c4-b5ece4e302df]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NElzDRty'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[415f7b1f-1710-4fb2-abf5-d77272ab6ea6]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b3209-d46b-45a4-9e48-f2de78d89e29]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:58 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:58 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e369e057-4f21-4810-a0a3-3d74390c7162]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260]
Nov 28 07:14:58 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260] successful.
Nov 28 07:14:58 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f9af8-efdd-4fa3-9e28-b12512045b28]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e0231-0458-43fb-825c-af71ccf5f04d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:58 user nova-compute[74870]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 (non-flash)
Nov 28 07:14:58 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:14:58 user nova-compute[74870]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 (non-flash)
Nov 28 07:14:58 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac0f8b-3dfc-41d8-ad81-a107578e9d94]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:14:58 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NElzDRty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23865323566313633', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865323566313633', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG nova.objects.instance [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:14:59 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:14:59 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:14:59 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:14:59 user nova-compute[74870]:   <serial>6b7cc2c3-314a-427b-a874-d196a20f6370</serial>
Nov 28 07:14:59 user nova-compute[74870]: </disk>
Nov 28 07:14:59 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No VIF found with MAC fa:16:3e:e8:89:6d, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.531s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:14:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:02 user nova-compute[74870]: INFO nova.compute.manager [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Detaching volume 6b7cc2c3-314a-427b-a874-d196a20f6370
Nov 28 07:15:02 user nova-compute[74870]: INFO nova.virt.block_device [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attempting to driver detach volume 6b7cc2c3-314a-427b-a874-d196a20f6370 from mountpoint /dev/vdb
Nov 28 07:15:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Attempting to detach device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:15:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:15:02 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:15:02 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:15:02 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:15:02 user nova-compute[74870]:   <serial>6b7cc2c3-314a-427b-a874-d196a20f6370</serial>
Nov 28 07:15:02 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:15:02 user nova-compute[74870]: </disk>
Nov 28 07:15:02 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:15:02 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config.
Nov 28 07:15:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:15:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:15:02 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:15:02 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:15:02 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:15:02 user nova-compute[74870]:   <serial>6b7cc2c3-314a-427b-a874-d196a20f6370</serial>
Nov 28 07:15:02 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:15:02 user nova-compute[74870]: </disk>
Nov 28 07:15:02 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:15:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:15:03 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:15:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:15:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:22 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 is timed out.
Nov 28 07:15:22 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config.
Nov 28 07:15:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NElzDRty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:15:22 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f26ce9-1281-4dd4-a72e-50871af29992]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:15:22 user nova-compute[74870]: No targets found.
Nov 28 07:15:22 user nova-compute[74870]: iSNS:
Nov 28 07:15:22 user nova-compute[74870]: No targets found.
Nov 28 07:15:22 user nova-compute[74870]: STATIC:
Nov 28 07:15:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623
Nov 28 07:15:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:15:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:15:22 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370
Nov 28 07:15:22 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:15:22 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:15:22 user nova-compute[74870]: FIRMWARE:
Nov 28 07:15:22 user nova-compute[74870]: No targets found.
Nov 28 07:15:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:15:22 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:15:22 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7775c0-a2cd-4be8-aa95-a1a24e7ffc49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213d328-a837-482b-925b-a70612203d9f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:15:22 user nova-compute[74870]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 (non-flash)
Nov 28 07:15:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:15:22 user nova-compute[74870]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 (non-flash)
Nov 28 07:15:22 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc6ebac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:15:22 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca71c78-ef68-4b96-a813-c0d908863707]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4814e36-6517-425d-b4a0-10a8326c5938]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18030b86-e4ff-408e-8d5e-ddcee601dc20]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f09949-b8bf-4797-b680-6bcfa7d4acf2]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57f850f-74a1-476d-8f01-31c5eb8e50db]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e9c723-e48f-4eff-890f-19be9e332359]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260]
Nov 28 07:15:23 user nova-compute[74870]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370, portal: 172.16.0.220,3260] successful.
Nov 28 07:15:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b7cc2c3-314a-427b-a874-d196a20f6370 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bc73f7-1e06-4c45-8a1a-3fd07faa2113]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== disconnect_volume: return (295ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:15:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.871s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:38 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:40 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 07:15:41 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:15:41 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.13518524169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:15:41 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:15:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:15:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:15:47 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [{"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:15:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-bdcf8d61-12d6-4698-9c25-907b4cdaf294" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:15:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:15:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:15:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:15:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:15:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:15:55 user nova-compute[74870]: INFO nova.compute.manager [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attaching volume 3c93fdd4-11ad-4039-a441-7d850eb4edd5 to /dev/vdb
Nov 28 07:15:55 user nova-compute[74870]: DEBUG os_brick.utils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0d6d5-7b60-4b7e-981c-b9449268602d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4523699-6ae9-4010-86c2-464c22c6ed59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac0f004-9a1b-4da6-8803-14b35b57ae88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[980bdea5-c7fb-4539-8f4e-658ec2b0595b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:15:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:15:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:15:56 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:15:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53347a1-2611-4bb8-b0d6-d510bb772715]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:15:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:15:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:15:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:15:56 user nova-compute[74870]: DEBUG os_brick.utils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:15:56 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating existing volume attachment record: 5c06ee0f-9af7-4cd3-9e37-c4cea4099ee4 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:15:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YteLxjCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:16:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:16:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:16:02 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9438ddba-18d4-40e8-a832-acac25aba5bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:16:02 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58c540f-da0e-49ae-8c38-4f3bc59d8dcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5] added
Nov 28 07:16:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c2294-b506-40d5-8c1a-60d32d64296e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2412ad-db4a-4499-9377-4003e7baa0a3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YteLxjCl {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YteLxjCl" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7afa51a-00db-4db1-8624-a877c8c9aa49]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YteLxjCl'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd11a3b-9164-4825-8853-67053e603e30]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b2689e-6829-4d99-a9e5-206df60176a3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b40ffe-b8bf-4209-a274-3cc2e5026061]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260]
Nov 28 07:16:02 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260] successful.
Nov 28 07:16:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2532ab0-e7e5-46c5-ba9f-a962bab7b134]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[753271df-6006-4290-aebe-0cd9e7385696]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:02 user nova-compute[74870]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 (non-flash)
Nov 28 07:16:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:02 user nova-compute[74870]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 (non-flash)
Nov 28 07:16:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5d34b5-9745-468e-878f-865abae8c8f0]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:16:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YteLxjCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:16:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:16:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23139643530343564', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:16:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643530343564', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:16:03 user nova-compute[74870]: DEBUG nova.objects.instance [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:16:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:16:03 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:16:03 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:16:03 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:16:03 user nova-compute[74870]:   <serial>3c93fdd4-11ad-4039-a441-7d850eb4edd5</serial>
Nov 28 07:16:03 user nova-compute[74870]: </disk>
Nov 28 07:16:03 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:16:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:16:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:16:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] No VIF found with MAC fa:16:3e:e8:89:6d, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:16:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.738s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:16:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:16:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:16:07 user nova-compute[74870]: INFO nova.compute.manager [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Detaching volume 3c93fdd4-11ad-4039-a441-7d850eb4edd5
Nov 28 07:16:07 user nova-compute[74870]: INFO nova.virt.block_device [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Attempting to driver detach volume 3c93fdd4-11ad-4039-a441-7d850eb4edd5 from mountpoint /dev/vdb
Nov 28 07:16:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Attempting to detach device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:16:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:16:07 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:16:07 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:16:07 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:16:07 user nova-compute[74870]:   <serial>3c93fdd4-11ad-4039-a441-7d850eb4edd5</serial>
Nov 28 07:16:07 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:16:07 user nova-compute[74870]: </disk>
Nov 28 07:16:07 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:16:07 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the persistent domain config.
Nov 28 07:16:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:16:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:16:07 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:16:07 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:16:07 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:16:07 user nova-compute[74870]:   <serial>3c93fdd4-11ad-4039-a441-7d850eb4edd5</serial>
Nov 28 07:16:07 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:16:07 user nova-compute[74870]: </disk>
Nov 28 07:16:07 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:16:07 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-changed-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing instance network info cache due to event network-changed-84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG nova.network.neutron [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing network info cache for port 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updated VIF entry in instance network info cache for port 84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-changed-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing instance network info cache due to event network-changed-84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.network.neutron [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Refreshing network info cache for port 84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:16:10 user nova-compute[74870]: INFO nova.compute.manager [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Detaching volume 5009fb21-cca6-4be0-ab41-0f287101a623
Nov 28 07:16:10 user nova-compute[74870]: INFO nova.virt.block_device [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Attempting to driver detach volume 5009fb21-cca6-4be0-ab41-0f287101a623 from mountpoint /dev/vdb
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Attempting to detach device vdb from instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:16:10 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:16:10 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 07:16:10 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:16:10 user nova-compute[74870]:   <serial>5009fb21-cca6-4be0-ab41-0f287101a623</serial>
Nov 28 07:16:10 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:16:10 user nova-compute[74870]: </disk>
Nov 28 07:16:10 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:16:10 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully detached device vdb from instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b from the persistent domain config.
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:16:10 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:16:10 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:16:10 user nova-compute[74870]:   <source dev="/dev/sdc"/>
Nov 28 07:16:10 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:16:10 user nova-compute[74870]:   <serial>5009fb21-cca6-4be0-ab41-0f287101a623</serial>
Nov 28 07:16:10 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:16:10 user nova-compute[74870]: </disk>
Nov 28 07:16:10 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:16:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updated VIF entry in instance network info cache for port 84587c86-6386-484a-9255-14e747fdaa68. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:16:11 user nova-compute[74870]: DEBUG nova.network.neutron [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:16:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:16:11 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:16:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:27 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 is timed out.
Nov 28 07:16:27 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully detached device vdb from instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 from the live domain config.
Nov 28 07:16:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YteLxjCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:16:27 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acbb03-8f71-4763-8f0c-815caa7877f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:16:27 user nova-compute[74870]: No targets found.
Nov 28 07:16:27 user nova-compute[74870]: iSNS:
Nov 28 07:16:27 user nova-compute[74870]: No targets found.
Nov 28 07:16:27 user nova-compute[74870]: STATIC:
Nov 28 07:16:27 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5
Nov 28 07:16:27 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:16:27 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:16:27 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623
Nov 28 07:16:27 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:16:27 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:16:27 user nova-compute[74870]: FIRMWARE:
Nov 28 07:16:27 user nova-compute[74870]: No targets found.
Nov 28 07:16:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:16:27 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:16:27 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fbff61-ec7f-4835-a505-5a2b80f4c724]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f95184-0daa-4123-b91d-26936aadee2a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:27 user nova-compute[74870]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 (non-flash)
Nov 28 07:16:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:27 user nova-compute[74870]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 (non-flash)
Nov 28 07:16:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc3fc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[068e6186-a819-4f15-afb6-9917b5d617eb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47b5be-f1ae-4631-8d4f-a3cf27d18625]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b61427-c6ef-4c09-9dc1-903ca1d031d0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4000e20-6703-4ddc-b818-d51260d8bda5]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0468940-1d62-469c-90f6-856fa8ee360e]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea680d-9954-4769-8b61-954cba384f61]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260]
Nov 28 07:16:27 user nova-compute[74870]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5, portal: 172.16.0.220,3260] successful.
Nov 28 07:16:27 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c93fdd4-11ad-4039-a441-7d850eb4edd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f90957-730f-4ebf-a1c8-c9e8716f0dae]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] <== disconnect_volume: return (293ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:16:27 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:16:28 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'flavor' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:16:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:16:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:31 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b is timed out.
Nov 28 07:16:31 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully detached device vdb from instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b from the live domain config.
Nov 28 07:16:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMykjQBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:16:31 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c15c2-67fe-4b72-ac38-957df2e241c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:16:31 user nova-compute[74870]: No targets found.
Nov 28 07:16:31 user nova-compute[74870]: iSNS:
Nov 28 07:16:31 user nova-compute[74870]: No targets found.
Nov 28 07:16:31 user nova-compute[74870]: STATIC:
Nov 28 07:16:31 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623
Nov 28 07:16:31 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:16:31 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:16:31 user nova-compute[74870]: FIRMWARE:
Nov 28 07:16:31 user nova-compute[74870]: No targets found.
Nov 28 07:16:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:16:31 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:16:31 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3955c46-87b2-4a15-99f0-c335bce72c6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ae854-5f4b-4a21-aaf5-de06bb75c743]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 (non-flash)
Nov 28 07:16:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcedc470ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623'): ({'sdc'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Removing single pathed devices sdc {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[115bd488-14b2-4731-822a-04d5e771baaf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1625b133-dc20-47f1-8441-fee9396fd15a]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flushing IO for device /dev/sdc {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a864ebb-8085-406e-853a-31e99ec046bd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bebbfa4-0bee-4831-95b4-acfa3d562715]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] SCSI volumes sdc have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b037bbd-efd1-4984-99f1-565cbfe32e77]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ecd738-a440-4e4d-ae2b-b0b318ebb1b3]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260]
Nov 28 07:16:31 user nova-compute[74870]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623, portal: 172.16.0.220,3260] successful.
Nov 28 07:16:31 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5009fb21-cca6-4be0-ab41-0f287101a623 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ab1cb-271d-42b2-8638-f0e086ca325a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] <== disconnect_volume: return (264ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:16:31 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:16:32 user nova-compute[74870]: DEBUG nova.objects.instance [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'flavor' on Instance uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:16:32 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.792s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:16:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:16:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:16:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:16:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:16:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:16:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:16:43 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:16:43 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.133975982666016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:16:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:16:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:16:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:16:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:16:48 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:16:49 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [{"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:16:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:16:49 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:16:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:16:52 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:16:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:16:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:16:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:16:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:16:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:16:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:04 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:07 user nova-compute[74870]: INFO nova.compute.manager [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Terminating instance
Nov 28 07:17:07 user nova-compute[74870]: DEBUG nova.compute.manager [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:17:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.compute.manager [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-unplugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Instance destroyed successfully.
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.objects.instance [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'resources' on Instance uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1439575737',display_name='tempest-TestMinimumBasicScenario-server-1439575737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1439575737',id=52,image_ref='ba067348-4c02-4322-b6fa-c65ea1d8243b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwPqiZCyo6mJK/w64EvOXbjK3caBU7kucGR/ZC7nBhAgDHRSY1giVJTJl4rBjkMG7le9zRcL3udFSbWodWNaBkhKXsBwWK1O8H0Hg+t+cENiIB2v3o91IrOcSoyndKxHw==',key_name='tempest-TestMinimumBasicScenario-969944734',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:12:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af4e4870f934158819e183bbc7b499e',ramdisk_id='',reservation_id='r-ev0gydmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba067348-4c02-4322-b6fa-c65ea1d8243b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1726429113',owner_user_name='tempest-TestMinimumBasicScenario-1726429113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:14:25Z,user_data=None,user_id='41da15820f7d43dfad1503c8d7355e6c',uuid=0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converting VIF {"id": "84587c86-6386-484a-9255-14e747fdaa68", "address": "fa:16:3e:35:a8:ce", "network": {"id": "dd15a0ea-6ca0-4839-b3c1-2e1006503361", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1021606832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af4e4870f934158819e183bbc7b499e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84587c86-63", "ovs_interfaceid": "84587c86-6386-484a-9255-14e747fdaa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG os_vif [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84587c86-63, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5182ef12-588b-4fcf-bcc1-0c814239c804) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:08 user nova-compute[74870]: INFO os_vif [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a8:ce,bridge_name='br-int',has_traffic_filtering=True,id=84587c86-6386-484a-9255-14e747fdaa68,network=Network(dd15a0ea-6ca0-4839-b3c1-2e1006503361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84587c86-63')
Nov 28 07:17:08 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Deleting instance files /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b_del
Nov 28 07:17:08 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Deletion of /opt/stack/data/nova/instances/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b_del complete
Nov 28 07:17:08 user nova-compute[74870]: INFO nova.compute.manager [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 07:17:08 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:17:08 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:17:09 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:17:09 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Took 0.59 seconds to deallocate network for instance.
Nov 28 07:17:09 user nova-compute[74870]: DEBUG nova.compute.manager [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-deleted-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:17:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:09 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:17:09 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:17:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:09 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Deleted allocations for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b
Nov 28 07:17:09 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:17:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Acquiring lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:10 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Lock "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:10 user nova-compute[74870]: DEBUG nova.compute.manager [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] No waiting events found dispatching network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:17:10 user nova-compute[74870]: WARNING nova.compute.manager [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Received unexpected event network-vif-plugged-84587c86-6386-484a-9255-14e747fdaa68 for instance with vm_state deleted and task_state None.
Nov 28 07:17:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:22 user nova-compute[74870]: INFO nova.compute.manager [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Terminating instance
Nov 28 07:17:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-vif-unplugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] No waiting events found dispatching network-vif-unplugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:17:22 user nova-compute[74870]: DEBUG nova.compute.manager [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-vif-unplugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:17:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Instance destroyed successfully.
Nov 28 07:17:23 user nova-compute[74870]: DEBUG nova.objects.instance [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'resources' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-769175374',display_name='tempest-SnapshotDataIntegrityTests-server-769175374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-769175374',id=51,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3NrfXE/HrSeGiVxVbPsssOqTBM+VWsglMxdYixhqCA8Ly6ap7KrPQ6mUDJggU4QVaW7QjiWuqoy4r2ZNqGY/uAA8z2NhInCXcANojwzpuXmUChkJln9MGwgR9qpzyREg==',key_name='tempest-keypair-1050103458',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799dd9fcfea94665b9b9a97393f442f2',ramdisk_id='',reservation_id='r-45v95yry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-29578551',owner_user_name='tempest-SnapshotDataIntegrityTests-29578551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6adcf7b17de430a81e4f3adbb800919',uuid=bdcf8d61-12d6-4698-9c25-907b4cdaf294,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Converting VIF {"id": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "address": "fa:16:3e:e8:89:6d", "network": {"id": "976a62e9-e249-4df0-a777-4e02de519ea9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-180949924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799dd9fcfea94665b9b9a97393f442f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf75c9d-e8", "ovs_interfaceid": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG os_vif [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecf75c9d-e8, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d14bad4-8c57-4284-861b-8d2d7030c308) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:23 user nova-compute[74870]: INFO os_vif [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:89:6d,bridge_name='br-int',has_traffic_filtering=True,id=ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20,network=Network(976a62e9-e249-4df0-a777-4e02de519ea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf75c9d-e8')
Nov 28 07:17:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Deleting instance files /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294_del
Nov 28 07:17:23 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Deletion of /opt/stack/data/nova/instances/bdcf8d61-12d6-4698-9c25-907b4cdaf294_del complete
Nov 28 07:17:23 user nova-compute[74870]: INFO nova.compute.manager [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 07:17:23 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:17:23 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:17:24 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Took 0.74 seconds to deallocate network for instance.
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:24 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Deleted allocations for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Acquiring lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Lock "bdcf8d61-12d6-4698-9c25-907b4cdaf294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] No waiting events found dispatching network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:17:24 user nova-compute[74870]: WARNING nova.compute.manager [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received unexpected event network-vif-plugged-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance with vm_state deleted and task_state None.
Nov 28 07:17:24 user nova-compute[74870]: DEBUG nova.compute.manager [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Received event network-vif-deleted-ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:17:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:40 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:17:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:17:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=9059MB free_disk=25.188922882080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:17:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:17:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:17:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:17:47 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 07:17:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:17:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:51 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:17:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:17:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:17:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:18:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:01 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:18:16 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:18:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:18:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:18:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:18:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:18:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:18:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:18:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:18:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:41 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:18:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:18:44 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.21713638305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:18:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:18:45 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:18:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:18:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:18:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Starting instance... {{(pid=74870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 07:19:00 user nova-compute[74870]: INFO nova.compute.claims [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Claim successful on node user
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Start building networks asynchronously for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Allocating IP information in the background. {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] allocate_for_instance() {{(pid=74870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 07:19:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Start building block device mappings for instance. {{(pid=74870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.policy [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc8687cad2e4adb888c8f889e915ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68236ceaeff245b795f960f8c76dc912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74870) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Start spawning the instance on the hypervisor. {{(pid=74870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Creating instance directory {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 07:19:00 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Creating image(s)
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "/opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "/opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "/opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.199s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:00 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.184s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk 1073741824 {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c,backing_fmt=raw /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk 1073741824" returned: 0 in 0.072s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "f17719a5f0481537c6d4d509b80e0c447185ae6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f17719a5f0481537c6d4d509b80e0c447185ae6c --force-share --output=json" returned: 0 in 0.186s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk. size=1073741824 {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Successfully created port: 3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG nova.virt.disk.api [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Cannot resize image /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk to a smaller size. {{(pid=74870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Created local disks {{(pid=74870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Ensure instance console log exists: /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/console.log {{(pid=74870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:01 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Successfully updated port: 3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Building network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-changed-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.compute.manager [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Refreshing instance network info cache due to event network-changed-3ab39d3c-226f-4dc7-82d6-0a5c72305f27. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Instance cache missing network info. {{(pid=74870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Instance network_info: |[{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Refreshing network info cache for port 3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Start _get_guest_xml network_info=[{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'f62a76e5-f00c-416b-84d0-db9b754396ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 07:19:02 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:19:02 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CPU controller missing on host. {{(pid=74870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.host [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CPU controller found on host. {{(pid=74870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T06:34:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T06:34:32Z,direct_url=<?>,disk_format='qcow2',id=f62a76e5-f00c-416b-84d0-db9b754396ab,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eeb6ee6e11b14c2eb40a470bed25b76d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T06:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flavor limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Image limits 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flavor pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Image pref 0:0:0 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Got 1 possible topologies {{(pid=74870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-263195453',display_name='tempest-SnapshotDataIntegrityTests-server-263195453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-263195453',id=53,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXbrnHRsFwacr5v9YfBpNJSMg5lP+utOEuXsZDViJUnDbMoD4s74lS9jPlZbwoHMZuBw2gwIA270MFTr/cSX68hUHulrGPbTO07K0Uv7Vfc63lNfhD0c44NP/vOPByAag==',key_name='tempest-keypair-1169283717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68236ceaeff245b795f960f8c76dc912',ramdisk_id='',reservation_id='r-e0lvjxtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1003009732',owner_user_name='tempest-SnapshotDataIntegrityTests-1003009732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc8687cad2e4adb888c8f889e915ac3',uuid=539b0e5c-0f78-46aa-96fb-4b9953d3cd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Converting VIF {"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.objects.instance [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'pci_devices' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] End _get_guest_xml xml=<domain type="kvm">
Nov 28 07:19:02 user nova-compute[74870]:   <uuid>539b0e5c-0f78-46aa-96fb-4b9953d3cd02</uuid>
Nov 28 07:19:02 user nova-compute[74870]:   <name>instance-00000035</name>
Nov 28 07:19:02 user nova-compute[74870]:   <memory>524288</memory>
Nov 28 07:19:02 user nova-compute[74870]:   <vcpu>1</vcpu>
Nov 28 07:19:02 user nova-compute[74870]:   <metadata>
Nov 28 07:19:02 user nova-compute[74870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 07:19:02 user nova-compute[74870]:       <nova:package version="0.0.0"/>
Nov 28 07:19:02 user nova-compute[74870]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-263195453</nova:name>
Nov 28 07:19:02 user nova-compute[74870]:       <nova:creationTime>2023-11-28 07:19:02</nova:creationTime>
Nov 28 07:19:02 user nova-compute[74870]:       <nova:flavor name="m1.tiny">
Nov 28 07:19:02 user nova-compute[74870]:         <nova:memory>512</nova:memory>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:disk>1</nova:disk>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:swap>0</nova:swap>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:vcpus>1</nova:vcpus>
Nov 28 07:19:02 user nova-compute[74870]:       </nova:flavor>
Nov 28 07:19:02 user nova-compute[74870]:       <nova:owner>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:user uuid="6bc8687cad2e4adb888c8f889e915ac3">tempest-SnapshotDataIntegrityTests-1003009732-project-member</nova:user>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:project uuid="68236ceaeff245b795f960f8c76dc912">tempest-SnapshotDataIntegrityTests-1003009732</nova:project>
Nov 28 07:19:02 user nova-compute[74870]:       </nova:owner>
Nov 28 07:19:02 user nova-compute[74870]:       <nova:root type="image" uuid="f62a76e5-f00c-416b-84d0-db9b754396ab"/>
Nov 28 07:19:02 user nova-compute[74870]:       <nova:ports>
Nov 28 07:19:02 user nova-compute[74870]:         <nova:port uuid="3ab39d3c-226f-4dc7-82d6-0a5c72305f27">
Nov 28 07:19:02 user nova-compute[74870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 07:19:02 user nova-compute[74870]:         </nova:port>
Nov 28 07:19:02 user nova-compute[74870]:       </nova:ports>
Nov 28 07:19:02 user nova-compute[74870]:     </nova:instance>
Nov 28 07:19:02 user nova-compute[74870]:   </metadata>
Nov 28 07:19:02 user nova-compute[74870]:   <sysinfo type="smbios">
Nov 28 07:19:02 user nova-compute[74870]:     <system>
Nov 28 07:19:02 user nova-compute[74870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 07:19:02 user nova-compute[74870]:       <entry name="product">OpenStack Nova</entry>
Nov 28 07:19:02 user nova-compute[74870]:       <entry name="version">0.0.0</entry>
Nov 28 07:19:02 user nova-compute[74870]:       <entry name="serial">539b0e5c-0f78-46aa-96fb-4b9953d3cd02</entry>
Nov 28 07:19:02 user nova-compute[74870]:       <entry name="uuid">539b0e5c-0f78-46aa-96fb-4b9953d3cd02</entry>
Nov 28 07:19:02 user nova-compute[74870]:       <entry name="family">Virtual Machine</entry>
Nov 28 07:19:02 user nova-compute[74870]:     </system>
Nov 28 07:19:02 user nova-compute[74870]:   </sysinfo>
Nov 28 07:19:02 user nova-compute[74870]:   <os>
Nov 28 07:19:02 user nova-compute[74870]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 07:19:02 user nova-compute[74870]:     <boot dev="hd"/>
Nov 28 07:19:02 user nova-compute[74870]:     <smbios mode="sysinfo"/>
Nov 28 07:19:02 user nova-compute[74870]:   </os>
Nov 28 07:19:02 user nova-compute[74870]:   <features>
Nov 28 07:19:02 user nova-compute[74870]:     <acpi/>
Nov 28 07:19:02 user nova-compute[74870]:     <apic/>
Nov 28 07:19:02 user nova-compute[74870]:     <vmcoreinfo/>
Nov 28 07:19:02 user nova-compute[74870]:   </features>
Nov 28 07:19:02 user nova-compute[74870]:   <clock offset="utc">
Nov 28 07:19:02 user nova-compute[74870]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 07:19:02 user nova-compute[74870]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 07:19:02 user nova-compute[74870]:     <timer name="hpet" present="no"/>
Nov 28 07:19:02 user nova-compute[74870]:   </clock>
Nov 28 07:19:02 user nova-compute[74870]:   <cpu mode="custom" match="exact">
Nov 28 07:19:02 user nova-compute[74870]:     <model>Nehalem</model>
Nov 28 07:19:02 user nova-compute[74870]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 07:19:02 user nova-compute[74870]:   </cpu>
Nov 28 07:19:02 user nova-compute[74870]:   <devices>
Nov 28 07:19:02 user nova-compute[74870]:     <disk type="file" device="disk">
Nov 28 07:19:02 user nova-compute[74870]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 07:19:02 user nova-compute[74870]:       <source file="/opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk"/>
Nov 28 07:19:02 user nova-compute[74870]:       <target dev="vda" bus="virtio"/>
Nov 28 07:19:02 user nova-compute[74870]:     </disk>
Nov 28 07:19:02 user nova-compute[74870]:     <interface type="ethernet">
Nov 28 07:19:02 user nova-compute[74870]:       <mac address="fa:16:3e:12:4d:0e"/>
Nov 28 07:19:02 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:19:02 user nova-compute[74870]:       <mtu size="1442"/>
Nov 28 07:19:02 user nova-compute[74870]:       <target dev="tap3ab39d3c-22"/>
Nov 28 07:19:02 user nova-compute[74870]:     </interface>
Nov 28 07:19:02 user nova-compute[74870]:     <serial type="pty">
Nov 28 07:19:02 user nova-compute[74870]:       <log file="/opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/console.log" append="off"/>
Nov 28 07:19:02 user nova-compute[74870]:     </serial>
Nov 28 07:19:02 user nova-compute[74870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 07:19:02 user nova-compute[74870]:     <video>
Nov 28 07:19:02 user nova-compute[74870]:       <model type="virtio"/>
Nov 28 07:19:02 user nova-compute[74870]:     </video>
Nov 28 07:19:02 user nova-compute[74870]:     <rng model="virtio">
Nov 28 07:19:02 user nova-compute[74870]:       <backend model="random">/dev/urandom</backend>
Nov 28 07:19:02 user nova-compute[74870]:     </rng>
Nov 28 07:19:02 user nova-compute[74870]:     <controller type="usb" index="0" model="none"/>
Nov 28 07:19:02 user nova-compute[74870]:     <memballoon model="virtio">
Nov 28 07:19:02 user nova-compute[74870]:       <stats period="10"/>
Nov 28 07:19:02 user nova-compute[74870]:     </memballoon>
Nov 28 07:19:02 user nova-compute[74870]:   </devices>
Nov 28 07:19:02 user nova-compute[74870]: </domain>
Nov 28 07:19:02 user nova-compute[74870]:  {{(pid=74870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-263195453',display_name='tempest-SnapshotDataIntegrityTests-server-263195453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-263195453',id=53,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXbrnHRsFwacr5v9YfBpNJSMg5lP+utOEuXsZDViJUnDbMoD4s74lS9jPlZbwoHMZuBw2gwIA270MFTr/cSX68hUHulrGPbTO07K0Uv7Vfc63lNfhD0c44NP/vOPByAag==',key_name='tempest-keypair-1169283717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68236ceaeff245b795f960f8c76dc912',ramdisk_id='',reservation_id='r-e0lvjxtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1003009732',owner_user_name='tempest-SnapshotDataIntegrityTests-1003009732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T07:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc8687cad2e4adb888c8f889e915ac3',uuid=539b0e5c-0f78-46aa-96fb-4b9953d3cd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Converting VIF {"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG os_vif [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22') {{(pid=74870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24389b73-df30-5a36-927a-e59fbd9e7e0f', '_type': 'linux-noop'}}, row=False) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ab39d3c-22, may_exist=True, interface_attrs={}) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ab39d3c-22, col_values=(('qos', UUID('c451305b-2c5f-486b-abae-f9ff93e398d7')),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ab39d3c-22, col_values=(('external_ids', {'iface-id': '3ab39d3c-226f-4dc7-82d6-0a5c72305f27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4d:0e', 'vm-uuid': '539b0e5c-0f78-46aa-96fb-4b9953d3cd02'}),), if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:02 user nova-compute[74870]: INFO os_vif [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22')
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No VIF found with MAC fa:16:3e:12:4d:0e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated VIF entry in instance network info cache for port 3ab39d3c-226f-4dc7-82d6-0a5c72305f27. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG nova.network.neutron [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:19:02 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:04 user nova-compute[74870]: DEBUG nova.compute.manager [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] No waiting events found dispatching network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:19:04 user nova-compute[74870]: WARNING nova.compute.manager [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received unexpected event network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance with vm_state building and task_state spawning.
Nov 28 07:19:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Instance event wait completed in 0 seconds for  {{(pid=74870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Guest created on hypervisor {{(pid=74870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 07:19:06 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Instance spawned successfully.
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Found default for hw_cdrom_bus of ide {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Found default for hw_disk_bus of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Found default for hw_input_bus of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Found default for hw_pointer_model of None {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Found default for hw_video_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Found default for hw_vif_model of virtio {{(pid=74870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.compute.manager [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] No waiting events found dispatching network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:19:06 user nova-compute[74870]: WARNING nova.compute.manager [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received unexpected event network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance with vm_state building and task_state spawning.
Nov 28 07:19:06 user nova-compute[74870]: INFO nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 28 07:19:06 user nova-compute[74870]: DEBUG nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Checking state {{(pid=74870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 07:19:06 user nova-compute[74870]: INFO nova.compute.manager [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Took 6.81 seconds to build instance.
Nov 28 07:19:07 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.946s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:42 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:43 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:19:46 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:19:46 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:19:46 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=25.174789428710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:19:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:19:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:19:50 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:19:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:19:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:19:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:19:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:19:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:19:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:19:57 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:57 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:19:57 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 07:19:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:01 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:01 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 07:20:01 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 07:20:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:20:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:20:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:20:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:12 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:17 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:22 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:27 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:32 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:20:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:20:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:20:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:20:42 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:44 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:47 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:20:47 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:20:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.17365264892578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:20:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:20:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-changed-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG nova.compute.manager [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Refreshing instance network info cache due to event network-changed-3ab39d3c-226f-4dc7-82d6-0a5c72305f27. {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG nova.network.neutron [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Refreshing network info cache for port 3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG nova.network.neutron [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated VIF entry in instance network info cache for port 3ab39d3c-226f-4dc7-82d6-0a5c72305f27. {{(pid=74870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG nova.network.neutron [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:20:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:20:52 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:20:55 user nova-compute[74870]: INFO nova.compute.manager [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attaching volume 493fccde-4838-4d33-bc81-d922f1149444 to /dev/vdb
Nov 28 07:20:55 user nova-compute[74870]: DEBUG os_brick.utils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:20:55 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdbde5c-2338-4bf7-8f78-9cb9f02d560c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c569733-8428-48d6-a143-d311878b2399]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b5a22f-3b85-4974-9bd5-a4b15afb2b6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f716f9-a7f9-45f9-aff2-e6a38c5dd76c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:20:56 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:20:56 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e6722-8e1b-40a3-9982-f357e4414536]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG os_brick.utils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:20:56 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating existing volume attachment record: b9060b19-6280-4d81-96bc-847de599c848 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:20:57 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:20:57 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:00 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kliWKInh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:21:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:21:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:21:02 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef1b734-5bb0-44e1-9a13-3e009adb0df5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:21:02 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bca921-fa35-4d77-83ba-395dbd0417a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444] added
Nov 28 07:21:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2186b4-dcf7-426f-972e-6b8bb788026b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e2f3ef-3ca0-4f7a-b6ae-e3749be47e1d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kliWKInh {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kliWKInh" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[29de74b6-5eb1-4ecf-ad78-8966e0021ac8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kliWKInh'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79fa308-8776-4ee5-a62e-4e80986b3bc2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1688339f-ab97-41cc-bf3a-d7cf38f38fa0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:21:02 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:21:02 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:21:02 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 07:21:02 user nova-compute[74870]: 
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4daecd-930c-451b-af35-507a8033c663]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260]
Nov 28 07:21:02 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260] successful.
Nov 28 07:21:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b733f85-514e-4e7b-91ec-1911126354d3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[59371c61-2798-4d7a-ba58-00bc2d5968c9]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 (non-flash)
Nov 28 07:21:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 (non-flash)
Nov 28 07:21:02 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fd4b64-9753-48ba-b19f-1a77741ca0e5]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kliWKInh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:21:02 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:21:03 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23039653036343937', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:21:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039653036343937', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:21:03 user nova-compute[74870]: DEBUG nova.objects.instance [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:21:03 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:21:03 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:21:03 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:21:03 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:21:03 user nova-compute[74870]:   <serial>493fccde-4838-4d33-bc81-d922f1149444</serial>
Nov 28 07:21:03 user nova-compute[74870]: </disk>
Nov 28 07:21:03 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:21:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:21:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:21:04 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No VIF found with MAC fa:16:3e:12:4d:0e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:21:04 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.500s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:21:05 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:07 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:10 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:21:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:21:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:18 user nova-compute[74870]: INFO nova.compute.manager [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Detaching volume 493fccde-4838-4d33-bc81-d922f1149444
Nov 28 07:21:18 user nova-compute[74870]: INFO nova.virt.block_device [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attempting to driver detach volume 493fccde-4838-4d33-bc81-d922f1149444 from mountpoint /dev/vdb
Nov 28 07:21:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Attempting to detach device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:21:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:21:18 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:21:18 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:21:18 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:21:18 user nova-compute[74870]:   <serial>493fccde-4838-4d33-bc81-d922f1149444</serial>
Nov 28 07:21:18 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:21:18 user nova-compute[74870]: </disk>
Nov 28 07:21:18 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:21:18 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config.
Nov 28 07:21:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:21:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:21:18 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:21:18 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:21:18 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:21:18 user nova-compute[74870]:   <serial>493fccde-4838-4d33-bc81-d922f1149444</serial>
Nov 28 07:21:18 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:21:18 user nova-compute[74870]: </disk>
Nov 28 07:21:18 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:21:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:21:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:21:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:21:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:21:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:21:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:38 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 is timed out.
Nov 28 07:21:38 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config.
Nov 28 07:21:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kliWKInh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:21:38 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5afdd87-ad87-463a-89dc-fa542fc8d0a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:21:38 user nova-compute[74870]: No targets found.
Nov 28 07:21:38 user nova-compute[74870]: iSNS:
Nov 28 07:21:38 user nova-compute[74870]: No targets found.
Nov 28 07:21:38 user nova-compute[74870]: STATIC:
Nov 28 07:21:38 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444
Nov 28 07:21:38 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:21:38 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:21:38 user nova-compute[74870]: FIRMWARE:
Nov 28 07:21:38 user nova-compute[74870]: No targets found.
Nov 28 07:21:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:21:38 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:21:38 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d4e9e-dd2d-4d5d-ac95-db15bae72e6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a251afc-a7f9-482b-aab7-aea31ee4a300]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 (non-flash)
Nov 28 07:21:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 (non-flash)
Nov 28 07:21:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc446050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcf1a20-3178-4e3a-bf8a-93c6f28535e1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a160b-56ef-45fa-81c0-f68c3c1e17f4]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a78439-1a96-43a0-a525-a0ad4006c6b1]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[010967de-a584-4619-b843-7015c5228da2]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9454e-8430-4fc9-b745-3b431d496835]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c834335-2024-4d26-a043-2019db4582e0]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260]
Nov 28 07:21:38 user nova-compute[74870]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444, portal: 172.16.0.220,3260] successful.
Nov 28 07:21:38 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493fccde-4838-4d33-bc81-d922f1149444 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[033cfa40-2ef8-49ca-b61e-7ebc4e2d6fad]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== disconnect_volume: return (266ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:21:38 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:21:39 user nova-compute[74870]: DEBUG nova.objects.instance [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:21:39 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.547s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:21:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:21:47 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:21:47 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:21:47 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.172374725341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:21:47 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:21:48 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:21:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:21:52 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:57 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:21:57 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:21:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:21:59 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:22:11 user nova-compute[74870]: INFO nova.compute.manager [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attaching volume 04d97406-282f-4111-9893-c6ac03d29a4e to /dev/vdb
Nov 28 07:22:11 user nova-compute[74870]: DEBUG os_brick.utils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a212b1-1a72-475d-9fcf-ab4a6e05bc95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a52360e-a16e-45fa-96b1-7fdf57f5b213]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25094ac-8ba0-456c-9c1f-65a7fc127b15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56b4d5-7041-4a4b-ab9d-bd61736f64f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:22:11 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:22:11 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f168d6-e460-472c-aa27-b62211256342]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG os_brick.utils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:22:11 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating existing volume attachment record: 71426d7e-8a20-4829-a260-15ebbfd7fe01 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:22:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:22:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOUejuXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:22:17 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:22:17 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:22:17 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d0bdd-dcb8-42ca-8c51-e79029801696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:22:17 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24776686-6da2-45be-9330-9c6fcae8e265]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e] added
Nov 28 07:22:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc605e-039b-45e9-80e0-ccb903af2f3b]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd53244-7108-4936-a0a4-eb81be762b9a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOUejuXy {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOUejuXy" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e39944-29af-4ff9-82e6-2797d711abea]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fOUejuXy'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8045ebe-6f5e-4038-b24a-44e9e8af33d0]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80abcc1-9321-443a-9f2c-2e28a07421b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:22:17 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:22:17 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:22:17 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 07:22:17 user nova-compute[74870]: 
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257d51c-9257-45ec-a589-687eb8493126]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260]
Nov 28 07:22:17 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260] successful.
Nov 28 07:22:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b71dd8c-6be2-4506-9992-7be7797153ce]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac43002-681a-4fa3-9402-9f51ad2a02d8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e (non-flash)
Nov 28 07:22:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e (non-flash)
Nov 28 07:22:17 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97814d5d-ed7e-43d1-a233-47d959431864]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:22:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOUejuXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:22:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:22:18 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23864323762656139', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:22:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864323762656139', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:22:18 user nova-compute[74870]: DEBUG nova.objects.instance [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:22:18 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:22:18 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:22:18 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:22:18 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:22:18 user nova-compute[74870]:   <serial>04d97406-282f-4111-9893-c6ac03d29a4e</serial>
Nov 28 07:22:18 user nova-compute[74870]: </disk>
Nov 28 07:22:18 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:22:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:22:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:22:19 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No VIF found with MAC fa:16:3e:12:4d:0e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:22:19 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.217s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:22:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:22:21 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:22:21 user nova-compute[74870]: INFO nova.compute.manager [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Detaching volume 04d97406-282f-4111-9893-c6ac03d29a4e
Nov 28 07:22:21 user nova-compute[74870]: INFO nova.virt.block_device [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attempting to driver detach volume 04d97406-282f-4111-9893-c6ac03d29a4e from mountpoint /dev/vdb
Nov 28 07:22:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Attempting to detach device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:22:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:22:21 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:22:21 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:22:21 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:22:21 user nova-compute[74870]:   <serial>04d97406-282f-4111-9893-c6ac03d29a4e</serial>
Nov 28 07:22:21 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:22:21 user nova-compute[74870]: </disk>
Nov 28 07:22:21 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:22:21 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config.
Nov 28 07:22:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:22:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:22:21 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:22:21 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:22:21 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:22:21 user nova-compute[74870]:   <serial>04d97406-282f-4111-9893-c6ac03d29a4e</serial>
Nov 28 07:22:21 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:22:21 user nova-compute[74870]: </disk>
Nov 28 07:22:21 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:22:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:22:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:42 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 is timed out.
Nov 28 07:22:42 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config.
Nov 28 07:22:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOUejuXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:22:42 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[503cc588-800f-43b2-aad1-fbd1b08ea6d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:22:42 user nova-compute[74870]: No targets found.
Nov 28 07:22:42 user nova-compute[74870]: iSNS:
Nov 28 07:22:42 user nova-compute[74870]: No targets found.
Nov 28 07:22:42 user nova-compute[74870]: STATIC:
Nov 28 07:22:42 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e
Nov 28 07:22:42 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:22:42 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:22:42 user nova-compute[74870]: FIRMWARE:
Nov 28 07:22:42 user nova-compute[74870]: No targets found.
Nov 28 07:22:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:22:42 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:22:42 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3904d9ca-44d0-4807-9f37-34a08c7350d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a519f503-7a25-4749-b269-062813573130]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e (non-flash)
Nov 28 07:22:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e (non-flash)
Nov 28 07:22:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc46a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9932e8-3ff0-46d8-8b07-7364ad331bbb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bf46f-9f76-4f63-ab15-6d3f2ce346fc]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d481e-139d-4499-a17a-21ad19799804]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[962de2ed-2cbb-4cc6-845d-c698c8bf61ee]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133ebd2-e72b-48bc-b750-0281856ec314]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ded899-8513-4d99-ac7c-86a0e7483110]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260]
Nov 28 07:22:42 user nova-compute[74870]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e, portal: 172.16.0.220,3260] successful.
Nov 28 07:22:42 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d97406-282f-4111-9893-c6ac03d29a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[de051cc8-911b-45ef-b3af-dfc05ff6a0be]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== disconnect_volume: return (280ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:22:42 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:22:43 user nova-compute[74870]: DEBUG nova.objects.instance [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:22:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:43 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:22:45 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:22:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:22:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:22:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:22:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:22:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:22:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:22:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.171401977539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:22:49 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:22:50 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:22:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:22:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:22:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:58 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:22:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:22:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:01 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:06 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:23:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:23:14 user nova-compute[74870]: INFO nova.compute.manager [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attaching volume 6947f7d8-d2fb-4309-90d7-4d03367aa3f9 to /dev/vdb
Nov 28 07:23:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86c277e-338d-4207-a9e1-6cb5f2fcbc2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc81b1-b6e2-4bae-a2dc-90932b923cd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae5daa-24b4-42cd-82a3-fa614b966fe9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f3a538-7dca-49a9-80d9-83b09ed138df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:23:14 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:23:14 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a494796a-bbc1-4e2c-bb67-f737355e9243]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG os_brick.utils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:23:14 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating existing volume attachment record: c90af924-ca8f-4631-904d-c64dc0509927 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:23:15 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWQBOlFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:23:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:23:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:23:21 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d14d60-6167-4861-a2ba-23c29e042641]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:23:21 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2378e88f-0948-4b74-a149-b77a39c11194]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9] added
Nov 28 07:23:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f22c7f-387a-452c-8d7e-942df53148fe]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba991901-b50c-4762-bba2-f3c663727a2d]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWQBOlFq {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWQBOlFq" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac5f8e-ade6-4543-a6f3-c724f6e94c03]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tWQBOlFq'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881adab-c3ad-457c-b08a-ddd97e91971f]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4359abe-6944-4ab6-8fdd-3155526295ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:23:21 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:23:21 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:23:21 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 07:23:21 user nova-compute[74870]: 
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced294b-b202-4fc1-9966-df4f46db7459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260]
Nov 28 07:23:21 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260] successful.
Nov 28 07:23:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d77ea4-ca62-4efe-9561-cb6dfc5edb74]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c335e-889a-4e4b-ae7f-ce960fbe1e3a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (non-flash)
Nov 28 07:23:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (non-flash)
Nov 28 07:23:21 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b50f60-e057-4f7e-9c96-c31e74fbb8ce]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:23:21 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWQBOlFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26431353132623432', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431353132623432', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG nova.objects.instance [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:23:22 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:23:22 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:23:22 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:23:22 user nova-compute[74870]:   <serial>6947f7d8-d2fb-4309-90d7-4d03367aa3f9</serial>
Nov 28 07:23:22 user nova-compute[74870]: </disk>
Nov 28 07:23:22 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:23:22 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No VIF found with MAC fa:16:3e:12:4d:0e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:23:23 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.296s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:23:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:23:24 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:23:24 user nova-compute[74870]: INFO nova.compute.manager [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Detaching volume 6947f7d8-d2fb-4309-90d7-4d03367aa3f9
Nov 28 07:23:24 user nova-compute[74870]: INFO nova.virt.block_device [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attempting to driver detach volume 6947f7d8-d2fb-4309-90d7-4d03367aa3f9 from mountpoint /dev/vdb
Nov 28 07:23:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Attempting to detach device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:23:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:23:24 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:23:24 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:23:24 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:23:24 user nova-compute[74870]:   <serial>6947f7d8-d2fb-4309-90d7-4d03367aa3f9</serial>
Nov 28 07:23:24 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:23:24 user nova-compute[74870]: </disk>
Nov 28 07:23:24 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:23:24 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config.
Nov 28 07:23:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:23:24 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:23:24 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:23:24 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:23:24 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:23:24 user nova-compute[74870]:   <serial>6947f7d8-d2fb-4309-90d7-4d03367aa3f9</serial>
Nov 28 07:23:24 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:23:24 user nova-compute[74870]: </disk>
Nov 28 07:23:24 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:23:25 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:23:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:23:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:23:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:45 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 is timed out.
Nov 28 07:23:45 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config.
Nov 28 07:23:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWQBOlFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:23:45 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dcba58-0b82-4841-a22d-6aa9d1bcb917]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:23:45 user nova-compute[74870]: No targets found.
Nov 28 07:23:45 user nova-compute[74870]: iSNS:
Nov 28 07:23:45 user nova-compute[74870]: No targets found.
Nov 28 07:23:45 user nova-compute[74870]: STATIC:
Nov 28 07:23:45 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9
Nov 28 07:23:45 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:23:45 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:23:45 user nova-compute[74870]: FIRMWARE:
Nov 28 07:23:45 user nova-compute[74870]: No targets found.
Nov 28 07:23:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:23:45 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:23:45 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8825dab5-249f-4d6b-9540-d88b7ed996d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7741ceef-78a1-4818-ba8e-2d4788e8c4a5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (non-flash)
Nov 28 07:23:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (non-flash)
Nov 28 07:23:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc6171c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d30d7a0-f0a9-4516-9903-28f785a50d2e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c93425-e69c-4777-8f6b-b9da33ffbc84]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4db873-d93d-4d0b-89da-4e11b03cc85c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6042259-9c91-4182-a46d-42f5beb1a79c]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63135b03-ffee-4848-b6d1-21d47aaf2dde]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.035s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5f2ee-1467-437e-ac73-5ab6cae310dc]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260]
Nov 28 07:23:45 user nova-compute[74870]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9, portal: 172.16.0.220,3260] successful.
Nov 28 07:23:45 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6947f7d8-d2fb-4309-90d7-4d03367aa3f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab63e703-c01e-4282-a73a-3f2211617b3c]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== disconnect_volume: return (268ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:23:45 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:23:46 user nova-compute[74870]: DEBUG nova.objects.instance [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:23:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.575s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:23:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:23:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:23:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:23:49 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.170391082763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:23:49 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:23:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:23:53 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:23:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:23:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:24:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:24:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:24:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:24:16 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:24:16 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:24:17 user nova-compute[74870]: INFO nova.compute.manager [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attaching volume 1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 to /dev/vdb
Nov 28 07:24:17 user nova-compute[74870]: DEBUG os_brick.utils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a2af2-c9b5-4dfa-8ac5-e35575ae10f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7629e748ab48\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d85329e-bed7-4814-8676-200e1d30aae6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb361d-7057-41a2-a739-72f3af3bf0d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[523f6a7d-29b1-4fe0-9e9b-11fb37e2388c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Running cmd (subprocess): nvme version {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 'nvme version' failed. Not Retrying. {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] nvme not present on system {{(pid=74870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 07:24:17 user nova-compute[74870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 07:24:17 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc371a-3c3d-4cf8-9469-5443c16affd8]: (4, '') {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] LIGHTOS: no hostnqn found. {{(pid=74870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG os_brick.utils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7629e748ab48', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:24:17 user nova-compute[74870]: DEBUG nova.virt.block_device [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating existing volume attachment record: 21556b31-47d3-4f92-9583-339f26e0d8a7 {{(pid=74870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 07:24:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:20 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Calling os-brick to attach iSCSI Volume {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAKeDGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:24:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:24:23 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:24:23 user nova-compute[74870]: INFO os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce2c228-68ae-4597-9e8e-4ddb6b473fe6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 07:24:23 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4128bf1f-f5ff-41c2-8ba0-1253eb3b00bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9] added\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9] added
Nov 28 07:24:23 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:23 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8987b849-1ade-4ad2-ba52-2dab835bebab]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4814493a-c186-4bad-8982-3e4c76d8fa6a]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAKeDGJY {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZAKeDGJY" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3990e51f-dfc2-4a3b-b620-0522c2b894b8]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZAKeDGJY'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5facc57-0186-4b01-8f4b-e407070f10f2]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[70990016-e577-4a8e-9363-852f2afe9f35]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:24:24 user nova-compute[74870]:  {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 07:24:24 user nova-compute[74870]:  {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:24:24 user nova-compute[74870]: WARNING os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 07:24:24 user nova-compute[74870]: 
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --login {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8278612c-cc77-431a-a806-b9a64d100c3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260]
Nov 28 07:24:24 user nova-compute[74870]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260] successful.
Nov 28 07:24:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1353a27-684e-418a-9695-bbfdb3750df3]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f4162-8eeb-4241-8c3d-9e22916931aa]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (non-flash)
Nov 28 07:24:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (non-flash)
Nov 28 07:24:24 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to 172.16.0.220:3260 {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d4904d-3000-4dff-83be-7eb5c010137e]: (4, ('- - 0', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 07:24:24 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAKeDGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26664376336666532', 'path': '/dev/sdb'} {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664376336666532', 'path': '/dev/sdb'} {{(pid=74870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG nova.objects.instance [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 07:24:25 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:24:25 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:24:25 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:24:25 user nova-compute[74870]:   <serial>1cff13b8-7e4d-41a1-b80d-a6500cccfdd9</serial>
Nov 28 07:24:25 user nova-compute[74870]: </disk>
Nov 28 07:24:25 user nova-compute[74870]:  {{(pid=74870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] No VIF found with MAC fa:16:3e:12:4d:0e, not building metadata {{(pid=74870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 07:24:25 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.616s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:24:28 user nova-compute[74870]: INFO nova.compute.manager [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Detaching volume 1cff13b8-7e4d-41a1-b80d-a6500cccfdd9
Nov 28 07:24:28 user nova-compute[74870]: INFO nova.virt.block_device [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Attempting to driver detach volume 1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 from mountpoint /dev/vdb
Nov 28 07:24:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Attempting to detach device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config. {{(pid=74870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:24:28 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:24:28 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:24:28 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:24:28 user nova-compute[74870]:   <serial>1cff13b8-7e4d-41a1-b80d-a6500cccfdd9</serial>
Nov 28 07:24:28 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:24:28 user nova-compute[74870]: </disk>
Nov 28 07:24:28 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:24:28 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the persistent domain config.
Nov 28 07:24:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config. {{(pid=74870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 07:24:28 user nova-compute[74870]: DEBUG nova.virt.libvirt.guest [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 07:24:28 user nova-compute[74870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 07:24:28 user nova-compute[74870]:   <source dev="/dev/sdb"/>
Nov 28 07:24:28 user nova-compute[74870]:   <target dev="vdb" bus="virtio"/>
Nov 28 07:24:28 user nova-compute[74870]:   <serial>1cff13b8-7e4d-41a1-b80d-a6500cccfdd9</serial>
Nov 28 07:24:28 user nova-compute[74870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 07:24:28 user nova-compute[74870]: </disk>
Nov 28 07:24:28 user nova-compute[74870]:  {{(pid=74870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 07:24:29 user nova-compute[74870]: DEBUG nova.virt.libvirt.driver [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 07:24:30 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:47 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:48 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:49 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 is timed out.
Nov 28 07:24:49 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully detached device vdb from instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 from the live domain config.
Nov 28 07:24:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] calling os-brick to detach iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcefc0d4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZAKeDGJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 07:24:49 user nova-compute[74870]: WARNING os_brick.initiator.connectors.base [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e54712-1a36-4c38-8cd3-51b9714cc5fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 07:24:49 user nova-compute[74870]: No targets found.
Nov 28 07:24:49 user nova-compute[74870]: iSNS:
Nov 28 07:24:49 user nova-compute[74870]: No targets found.
Nov 28 07:24:49 user nova-compute[74870]: STATIC:
Nov 28 07:24:49 user nova-compute[74870]: Target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9
Nov 28 07:24:49 user nova-compute[74870]:         Portal: 172.16.0.220:3260,-1
Nov 28 07:24:49 user nova-compute[74870]:                 Iface Name: default
Nov 28 07:24:49 user nova-compute[74870]: FIRMWARE:
Nov 28 07:24:49 user nova-compute[74870]: No targets found.
Nov 28 07:24:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 07:24:49 user nova-compute[74870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 07:24:49 user nova-compute[74870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9', 0)] {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9963b7-5e69-4a01-b97c-120c65e2affa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f24484-68b9-4875-a25a-e931b3d38405]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (non-flash)\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (non-flash)
Nov 28 07:24:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (non-flash)
Nov 28 07:24:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcefc615120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9'): ({'sdb'}, set())}) {{(pid=74870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Removing single pathed devices sdb {{(pid=74870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152ff4b-deeb-47a2-b227-ec1bc7669282]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e9974-dd49-4e68-a722-afcc863c21bd]: (4, ('ok\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flushing IO for device /dev/sdb {{(pid=74870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e61ed6d-bedc-40da-9080-bb5205926c95]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c7074c-0bdd-4eab-89ca-4f0526ff9fbb]: (4, ('1', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.linuxscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] SCSI volumes sdb have been removed. {{(pid=74870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9')] {{(pid=74870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a58f8-ea23-4073-bfdd-d1ee86adeccd]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --logout {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b65649c-e40a-466f-8c3d-eb867ddbab6a]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260]
Nov 28 07:24:49 user nova-compute[74870]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9, portal: 172.16.0.220,3260] successful.
Nov 28 07:24:49 user nova-compute[74870]:  stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op delete {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85885) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2934a63-451f-44fa-acf2-968197921b63]: (4, ('', '')) {{(pid=85885) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.base [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG os_brick.initiator.connectors.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] <== disconnect_volume: return (284ms) None {{(pid=74870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 07:24:49 user nova-compute[74870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Disconnected iSCSI Volume {{(pid=74870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG nova.objects.instance [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'flavor' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.603s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.processutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 07:24:50 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:24:50 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:24:50 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.169448852539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:24:50 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:24:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:24:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:24:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:53 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquired lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Forcefully refreshing network info cache for instance {{(pid=74870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG nova.objects.instance [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lazy-loading 'info_cache' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG nova.network.neutron [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [{"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Releasing lock "refresh_cache-539b0e5c-0f78-46aa-96fb-4b9953d3cd02" {{(pid=74870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updated the network info_cache for instance {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 07:24:54 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:56 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:24:58 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:03 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:05 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:05 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 07:25:05 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] There are 0 instances to clean {{(pid=74870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 07:25:08 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:08 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:11 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:11 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 07:25:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:13 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:18 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:20 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:22 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:22 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Triggering sync for uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 07:25:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:22 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:23 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:28 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:33 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:38 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:43 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:44 user nova-compute[74870]: INFO nova.compute.manager [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Terminating instance
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.compute.manager [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Start destroying the instance on the hypervisor. {{(pid=74870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-vif-unplugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] No waiting events found dispatching network-vif-unplugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.compute.manager [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-vif-unplugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance with task_state deleting. {{(pid=74870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [-] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Instance destroyed successfully.
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.objects.instance [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'resources' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=74870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.virt.libvirt.vif [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T07:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-263195453',display_name='tempest-SnapshotDataIntegrityTests-server-263195453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-263195453',id=53,image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXbrnHRsFwacr5v9YfBpNJSMg5lP+utOEuXsZDViJUnDbMoD4s74lS9jPlZbwoHMZuBw2gwIA270MFTr/cSX68hUHulrGPbTO07K0Uv7Vfc63lNfhD0c44NP/vOPByAag==',key_name='tempest-keypair-1169283717',keypairs=<?>,launch_index=0,launched_at=2023-11-28T07:19:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68236ceaeff245b795f960f8c76dc912',ramdisk_id='',reservation_id='r-e0lvjxtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f62a76e5-f00c-416b-84d0-db9b754396ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1003009732',owner_user_name='tempest-SnapshotDataIntegrityTests-1003009732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T07:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc8687cad2e4adb888c8f889e915ac3',uuid=539b0e5c-0f78-46aa-96fb-4b9953d3cd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Converting VIF {"id": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "address": "fa:16:3e:12:4d:0e", "network": {"id": "2b4954c2-f2fd-4268-a13c-91e6d6532e82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-575668012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68236ceaeff245b795f960f8c76dc912", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab39d3c-22", "ovs_interfaceid": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.network.os_vif_util [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22') {{(pid=74870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG os_vif [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22') {{(pid=74870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ab39d3c-22, bridge=br-int, if_exists=True) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c451305b-2c5f-486b-abae-f9ff93e398d7) {{(pid=74870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:44 user nova-compute[74870]: INFO os_vif [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:4d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3ab39d3c-226f-4dc7-82d6-0a5c72305f27,network=Network(2b4954c2-f2fd-4268-a13c-91e6d6532e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab39d3c-22')
Nov 28 07:25:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Deleting instance files /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02_del
Nov 28 07:25:44 user nova-compute[74870]: INFO nova.virt.libvirt.driver [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Deletion of /opt/stack/data/nova/instances/539b0e5c-0f78-46aa-96fb-4b9953d3cd02_del complete
Nov 28 07:25:44 user nova-compute[74870]: INFO nova.compute.manager [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 07:25:44 user nova-compute[74870]: DEBUG oslo.service.loopingcall [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.compute.manager [-] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Deallocating network for instance {{(pid=74870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 07:25:44 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] deallocate_for_instance() {{(pid=74870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 07:25:45 user nova-compute[74870]: DEBUG nova.network.neutron [-] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Updating instance_info_cache with network_info: [] {{(pid=74870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 07:25:45 user nova-compute[74870]: INFO nova.compute.manager [-] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Took 0.77 seconds to deallocate network for instance.
Nov 28 07:25:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:45 user nova-compute[74870]: DEBUG nova.compute.manager [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-vif-deleted-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:25:45 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:25:45 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:25:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:45 user nova-compute[74870]: INFO nova.scheduler.client.report [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Deleted allocations for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02
Nov 28 07:25:45 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received event network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 07:25:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Acquiring lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:46 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Lock "539b0e5c-0f78-46aa-96fb-4b9953d3cd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:46 user nova-compute[74870]: DEBUG nova.compute.manager [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] No waiting events found dispatching network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 {{(pid=74870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 07:25:46 user nova-compute[74870]: WARNING nova.compute.manager [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Received unexpected event network-vif-plugged-3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance with vm_state deleted and task_state None.
Nov 28 07:25:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:25:51 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:25:51 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=25.196544647216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing inventories for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating ProviderTree inventory for provider 815baae3-b790-4d61-806d-4eb5745b5a72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Updating inventory in ProviderTree for provider 815baae3-b790-4d61-806d-4eb5745b5a72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing aggregate associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, aggregates: None {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Refreshing trait associations for resource provider 815baae3-b790-4d61-806d-4eb5745b5a72, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:25:51 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:25:53 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:25:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:25:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:25:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:25:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:25:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:25:55 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 07:25:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:57 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:58 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:25:58 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:25:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:26:04 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:07 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:09 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:14 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:26:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:26:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:26:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:26:19 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:24 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:29 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:26:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 07:26:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 07:26:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:26:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 07:26:34 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:35 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:37 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:39 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:40 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:44 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:49 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:49 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:51 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Auditing locally available compute resources for user (node: user) {{(pid=74870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 07:26:52 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:26:52 user nova-compute[74870]: WARNING nova.virt.libvirt.driver [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Hypervisor/Node resource view: name=user free_ram=9244MB free_disk=25.195388793945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.compute.provider_tree [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed in ProviderTree for provider: 815baae3-b790-4d61-806d-4eb5745b5a72 {{(pid=74870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.scheduler.client.report [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Inventory has not changed for provider 815baae3-b790-4d61-806d-4eb5745b5a72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG nova.compute.resource_tracker [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Compute_service record updated for user:user {{(pid=74870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 07:26:52 user nova-compute[74870]: DEBUG oslo_concurrency.lockutils [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 07:26:54 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 07:26:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:55 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:56 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Starting heal instance info cache {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 07:26:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Rebuilding the list of instances to heal {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 07:26:56 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Didn't find any instances for network info cache update. {{(pid=74870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 07:26:59 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:59 user nova-compute[74870]: DEBUG oslo_service.periodic_task [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 07:26:59 user nova-compute[74870]: DEBUG nova.compute.manager [None req-ff575539-018e-40db-96ad-0b1b8498c22a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 07:26:59 user nova-compute[74870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}